On Kodi, System settings/ system/ services -Control tab.
allow remote control via http - Off (unless required by you, then change the default port/user/pw).
allow remote control from apps on this system - Off (on will allow passthrough control from a kodi installed addon)
allow remote control from apps on other systems - Off

As for Android apps, each one has permissions that can be checked.
/Shooty