Definitely leave the nest alone for now. Dot the eggs with a sharpie, take a picture of them if you can and then go back the next day to compare. If the eggs haven’t moved they could be abandoned, especially if the female died. If she is gone nobody will incubate those eggs but their presence won’t stop any new birds from tossing them and most of the nest material if they want the box.
You could candle the eggs but I’m not thinking you need to do that. http://archive.is/pS5DK
Gin
Atlanta, GA