The Old Gaol was originally a jail so you can stay in the cells that used to house prisoners, either in cells that sleep 2, 3 or 6.
Whethu Backpackers is a small hostel in the suburbs of Grahamstown very easy walking into the city.