You need to equip a torch or acquire the glowing amulet from the Lizard Tribe questline to be able to go to caves.
you can also get a glowing amulet from the witch that has different stats
