Hi Nick & Tanya. The Sutro house was torn down by the same WPA crews who repaired the statuary. They also tore down his carriage house, the main gates and some other structures. The reasoning seems to be they were dilapidated and the City didn't have funds to maintain them.
Love to see your family photo albums. Maybe you can bring them to a future Cliff House get together?