This is the Civil War Hat location. You will find the Civil War hat in the basement of the building here. From the main gate it is the single story building on your right side. When you go through the doorway of the building the ladder will be in the back right of the room behind the barrels.
Found hats are unique hats that can only be found out in the world. They are permanently stored in your wardrobe when you find them.