So in the end got it up and running. Not with the Adafruit library, but with pololu’s one…
I’ve tried it on a Lolin C3 (this is not an easy device to use. There seems to be some hardware issues with the antenna). It Might be a bit buggy, my coding skills are very basic.
It needs the pololu/VL53L0X @ ^1.3.0 library to be included when building this.
For those interested you can find it here; https://github.com/martin072/WLED/tree/main/usermods/Animated_Staircase
@blazoncek Maybe you can integrate the changes into your version to make it standard available.