The building overlooks a hot spring which has been popular since the Colonial Period. The town advertises itself as "The Country's First Spa."
The castle has a "basement dungeon," which was at one time a popular feature of ghost tours given in the area.
The building is privately owned and not open to the public.
The town is officially incorporated as Bath, after the town in England which is also know for its springs.