The remains of the 8th century Moorish castle can be seen further down the hill from the Pena Palace