The castle belonged to Sir Walter Raleigh who sold the property to Sir Richard Boyle in 1602. Charlotte Elizabeth Boyle, the daughter and heiress of the 4th Earl of Cork, married William Spencer Cavendish, 4th Duke of Devonshire and when she died in 1754 the estate passed to the Cavendish family.
At the time of Griffith's Valuation, the castle was valued at £140. The 1943 ITA survey contains an extensive description of the castle and its grounds at that time.
It has remained in the hands of the Cavendish (Devonshire) estate, housing a prestigous art gallery. See www.lismorecastle.com.