There are a number of must-see landmarks in Nassau. At Rawson Square you’ll find historic government buildings, a public library and museum, the Queen's Staircase, Water Tower, historical forts, Gregory Arch and The Caves.