I wonder how your neighbors will feel bing under surveillance lol.
Seriously though you should check what your legal duties as regards filming in people's gardens etc. I know its only a little bit, but some people are very sensitive about it.
If it was my house I'm not sure how I would feel about it. 50% glad because its a crime dtereent, 50% invasion of privacy maybe.
I could stand outside your house pointing a video camera at it. Unless I cause you distress I wouldn't be doing anything wrong.
to be honest If I had kids playing in the street I would much rather have someones cctv watching them so to make sure there safe. It becomes a problem when its in peoples back gardens and as you can see on my photo you can hardly see anyones because of the fencing