Templar knights in Saint-Benoît-sur-Loire?

The façadeThe façade | ©Anecdotrip.com / CC-BY-NC-SA

This nice Romanesque house is also known as "Templars' house" or "White cross College house".

Did Templars knights live here? Or maybe Templars refer to Protestants, “people going to Temple”?