It's alright! They all have really charming names!
Building 14 is the closest building to the main building, by leaps and bounds over everything else. It's only about 250 feet from 14 to the main building. Building 27 is about 1200 feet away (i'm using a piece of string and a map, so these aren't very accurate).
By comparison, everything in the mansions is somewhere between 700-1000 feet from the main building, over a bridge. Only certain rooms on the south side of Oak are pool rooms. And like I said, only 2 rooms in Parterre fit, as well, so there's not as much variance between the distance in the mansions. The variance in AB is much higher. You could be closer, you could be farther.