Use shared office space
Shared office space or coworking environments offer meeting rooms, cubical or a part of a building for rent at a flat cost. These areas can be rented for scheduled days of the week or even hours of the day. This might be a smart option for a single person business that can benefit from an office, but does not need to have one open 24/7. This allows you to have a base of operations, but can lower the cost of traditional leasing.
You could rent a space for a day and schedule all your meetings on one day a week. It provides a business atmosphere, Internet access, telephone, and cubical or desk space without having to pay for time when you are not using it. Because there are also other people renting space in these locations, it may provide a great place to network with other small business owners as well.