The McCulloch House was originally a two-room brick structure with a detached kitchen. Dr. Josiah Caldwell, the official physician of McLennan County, purchased the property for $500 in gold at an 1866 public auction. Caldwell, his wife Maria, and their five children lived in the house from 1866 to 1872.