Ya the night is unacceptably dark if the moonlight isn't favourable, even with Infravision.
You can manage it by leaving your wilderness XP loop and going to find a place to grind in the city, or use a torch to get to a well lit MOB camp/dungeon until morning. But man, constantly being worried...