Yesterday I took out two huge boxwoods along the side fence of our yard, that have been there since we moved here in '95. I never really liked them that much. They acted as a good screen for privacy, but otherwise didn't contribute much towards the look of the garden. Plus, it collected a messy pile of leaves under it, that would blow all over the yard. So I cut them town and pulled up the roots, and now there is a lot of space to replace the boxwoods with something a little more exciting. Current thought is maybe two more Butterfly bushes:

Butterfly bush is one of my favorites. It's very easy to grow (requires practically no watering after it's first year), can be pruned to shape it to your liking, and the columns of pink and purple blooms attract bees and butterflys like crazy. Additionally, like gardenia, the flowers have a very pleasant scent. Buddleia tolerates even prolonged heat and drought without wilting. It's one tough shrub and flowers continuously (with deadheading) from mid-summer through fall. They generally grow from anywhere between 5 and 7 feet tall, about 5-6 feet wide. But like I said, they take heavy pruning well.
The other option is perhaps two or three more Rose-of-Sharon hibiscus. I already have one further back in the garden, that is about 3 feet tall right now and just starting to put out new buds.

Rose of Sharon grow into a tower of beautiful maple-shaped leaves and profuse pink, purple, white, or blue hibiscus-like flowers that bloom from mid-late summer all the way to first frost. Once they are established, they thrive with little care or attention. They'll get about 10-11 feet tall and about 6 feet wide. What I love about butterfly bush and Rose of Sharon is that they start their show while the rest of the garden is finishing up, so you have more blooms to enjoy into the fall.