Held by William O'Sullivan from the Bantry estate in 1852 when it was valued at £15 10s. Lewis refers to it as the seat of W. O'Sullivan in 1837. Slater refers to it as the seat of J.E. Barrett in 1894. The house takes its name from the original O'Sullivan castle located a short distance away.