The castle was built in 1622 by Christoph Wilhelm von Zelking where the houses of ten winemakers formerly stood. It has a block-like structure built around a small courtyard, and the side facing the Danube is flanked by two towers. The architect was probably Cipriano Biasino from Como, who lived in Krems and who also built the Krems Parish Church.
The castle changed hands through marriage in 1634 going to the Count of Zinzendorf and Pottendorf, who sold it to the Countess of Starhemberg in 1663. The Countess only used the castle occasionally when visiting the vineyard estate or when on a hunt. In September 1683, while Emperor Leopold I was visiting the Dürnstein Castle, the message arrived that Vienna had been freed from the Turkish occupation.
In 1937, Ernst Rüdiger von Starhemberg sold the castle to the Thiery family. In the 1960s, the castle was modified into a hotel, and is still being operated as such to this day.