Caving in the Peak District. Have you ever wondered what lies beneath the ground you are walking on? Well if you happen to visit the Castleton area of the Peak District then you should. Beneath you are a series of Caves and Caverns climbing down into the deep darkness below. They offer fresh exciting opportunities for fun, adventure and new experiences.