I still need to do some good ol' investigating! Castles have secret passages and stuff like that, it's possible there are some.

[...well, looking for information about the people in charge is the main objective here. Secret passages aren't really what he'll be looking for, but he won't complain if he finds any]