Indeed, there is no church. But you can leave the entrance just here, near the port and make it a secret place that way. What do you think?
But that's already dungeon. In fact, that dungeon has an entrance to the maltese abbey of it's own. It's opposite the stairway down from the town entrance.