but ground to ground the locals have the upper hand just by knowing the area and their neighbors

If they are being invaded, they also have the “advantage” of being a fucking ton of people.

Maintaining an invading army has completely different economic and social restrictions than just existing.