Kloostri began in the Middle Ages as a working estate of the Cistercian nunnery at Lihula, with a fortified main house. In 1611 Charles IX granted it to Johann von Derfelden, whose descendants held it for more than two centuries. In the mid-1600s the Derfeldens built a two-story Baroque stone house: the low ground floor held the household rooms and the tall upper floor the living and reception rooms, all under a high mansard hip roof. This rare Swedish-era manor house survived almost unchanged until 1939, when its timber parts were pulled down.