Never seen a cardinal nest like this before!

I saw cardinals building this nest and have never seen a bird nest like this! I don’t want to use this door and destroy the nest. It is now November, so the little ones are gone. Should i leave the nest alone? Will they come back? It is a perfectly protected area for a nest – smart cardinals!