I don’t know if wrens ever give up during nesting season. If you want to leave the boxes up, you should turn or relocate them to make finding the entrance harder.
Do you know for sure what they sound like? https://www.allaboutbirds.org/guide/House_Wren/sounds
Gin
Atlanta, GA