Antoine de Rochechouart, king François I's favourite, who hold concurrently titles of La Rochelle's governor, Toulouse's seneschal, Languedoc general lieutenant, built the castle circa 1530.
On the site of a former fortress, the new building, huge brick and stone main building, was decorated with Renaissance architectural elements. Some illustrious owners succeeded one another, especially Claude de Bourdeille, Bourdeille's nephew, or cardinal Mazarin, who purchased the estate in 1659.
In the 18th century, we had Guyot family, then engineer Paul Jeannerey, then count Nils de Barck. Finally, the city of Saint-Amand bought the castle in 1985 which is nowadays housing the museum of Puisaye sandstone.