Brilliantly positioned on Madison Avenue, it is a true New York landmark