The magic word. I find many, not all, Adafruit libraries will cause the ESP32 to fault in some form or fashion.
Have you tried disabling all libraries and then one at a time, reenable each library one at a time to find the fault. I'd start with Adafruit first.