The castle is situated in the village of Škrle near Chomutovka Stream in the southeast of the village. We have a written record of a stronghold that was situated here in 1621 and that was rebuilt into a one-storey Baroque Chateau in 1730.

After the administrative reform in the middle of the 19th century, Škrle became an autonomous municipality and the municipality authorities moved into the castle. After the Second World War the castle started falling into disrepair and several years after the revolution it was reconstructed; currently, the surroundings around the castle are being landscaped. There used to offices in the castle, but also a flat for the estate manager and guest rooms for Osek friars.