Visual and oral sources can provide primary source evidence. For example, try searching ArtStor for "day dress," and limiting the date range to 1880-1900.
Historical newspapers and periodicals are great resources for finding out about details of a historical period that might not make it into the history books. How did people advertise for a wet nurse? How were early electrical appliances marketed?
When pursuing primary source research, it's often helpful to go to look at digital collections at libraries from the area you're researching, as they will often have the most substantial collections on their area. The collections below might be especially helpful for research on Saratoga Springs.