Thankfully, Windows allows you to limit the app permissions in a couple of ways. To adjust permissions on a single app, go to Settings > Apps > Installed Apps.

To manage this, go into your Google account settings and pause or delete your Location History. You can also go to your phone ...