HERE TODAY, by the Junior League of San Francisco, came out in 1968 and was possibly the first book to try to capture the City's architectural heritage. One might now want to call it "Gone Today" because so many of the buildings featured in it are no longer with us. I long coveted this book and finally bought one at the Book Bay at Fort Mason, where they turn up occasionally.
As a kid I read FIFTH CHINESE DAUGHTER by Jade Snow Wong and it made a tremendous impression on me. It is a fascinating glimpse into Chinese culture in San Francisco as well as just being thoroughly enjoyable read.