Different levels of structures' strength?

[Sebiale]

Well Guys, People will just dig under the walls and fortifications.

I already covered this in the OP--you give the ground beneath a town block protection to a certain depth from anyone who isn't a town inhabitant.
The greatest threat in that situation are infiltrators and traitors. Traitors would need some really heavy RP justification.