2503 Pascagoula is significant within the context of Pascagoula's residential elements, being the most elaborate remaining example of the Queen Anne style in the city, and one of the best in Jackson County. The house is also significant for its association with Lemuel D Herrick, postmaster of Scranton. Old photographs indicate there were once quite a few very elaborate Queen Anne homes in Pascagoula, but most have been lost over the years. This house is one of only six surviving two-story Queen Anne houses in the city, and is by far the most complex and ostentatious example of the style. The elaborate wooden architectural details of the Queen Anne were tailor-made to the area's lumber industry. The complex roof with its multiple gables, tall slender chimney and conical roof tower; the variety of windows Queen Anne, double-hung, and circular; the decorative wood shingles, garlands, and porch railing with its paired columns set on pedestal, combine to create an outstanding example of domestic Queen Anne architecture and a showpiece of the products of local lumber industry.

The house was designed by John Stone and built for Capt Lemuel D Herrick, who acquired this lot in 1899. The Southern Manufacturer in 1899 carried an illustration of the house with the following caption:

The above is a fair cut of Captain L D Herrick's handsome home to be erected in the suburbs of Scranton on Pascagoula street. This part of town is rapidly building up with handsome homes. Mr. Hughes, Captain Herrick's business partner, is also to have a handsome home built very much on the same style as Captain Herrick's, on the adjoining piece of land.

One of the most liberal minded thinkers in regard to the future prospects of the Pascagoulas is Capt Herrick. He has been the Deputy Clerk at this point since October 1898. For eight successive years he was Post Master here. He is a member of the firm of Hughes & Herrick and a Director of the Scranton State Bank. A prominent Mason, K of P [Knights of Pythian], Odd Fellow, and one of the first officers of the Commercial Club. Capt. Herrick came to Scranton in 1887 from the North. He was one of the most active members of the Deep Water Commission that did such good work at Washington securing the appropriation [$317,600 for port improvements nomination].