Do you have the house on a pole & a baffle on the pole? That should at least help keep the cat from eggs/babies. Also, make sure it’s not close to a tree or a fence. That’s probably all you can do besides talking to your neighbor & asking them if they could confine the cat. That may be asking a lot according to your relationship with your neighbor.
Nicole