The problem isn't that individual people/cameras might have good memories. If the local mini-mart can call up a list of all my visits, purchases, and camera-footage of what car I arrived in, that's... icky but acceptable.

The violation and danger occurs when everybody/thing gets turned into a massive hivemind, and someone can trivially combine observations from all those individual entities to make a constant video of my entire day outside my dwelling. That's a qualitatively different level of (un-)privacy that people do not expect.

Ideally this information should be siloed except with a conscious decision by the neighbor/store/etc. in response to a particularized request. For example, "please share with me information from time X to Y of anyone running from place Z."