Throughout most of this era, the building was used for a hotel and residence for the J.W.C. Pogue family. In 1898-1904, the hotel was operated as a rooming house by Mrs. M. L. Moffett. The Moffetts leased the hotel and a blacksmith shop from J.W.C. Pogue, residing at the hotel until construction of their house was completed in 1904.

In 1904, Nora Alice Pogue, the youngest of the J.W.C. Pogue children, was given the Pogue Hotel, which had been her birthplace. In that same year, she married Dr. Robert Bruce Montgomery, Lemon Cove's first resident physician. The Montgomerys redecorated the hotel and lived in the house until 1920.

A more extensive remodeling was completed to effect the transformation from house to clubhouse. This work was completed in 1936 by Jonathan Early Ppgue, son of J.W.C. Pogue, prior to conveyance of the deed from Nora Pogue Montgomery to the Lemon Cove Woman's Club. - NRHP, 21 June 1991