You can find various online sources. However, Wikipedia claims that in addition to the regular "business" of housing POWs during the Civil War, there were horrible things that took place here during that time.
Dozens of spirits are said to roam free. They say the ghosts of Bonnie and Clyde still reside here. The most famous story? The Lady in White. *shivers*