I wouldn't make a separate cube map for say each side of the building,.. because it would use quite a lot of memory,..Very good one.
But I'd like to ask. If the example is a glass building, all the surface are glass. How would it be? Do we need more cube map?