LEDs flickering while using brightness

Yes thats right. Also Makuna suggested not using the NeoPixelBrightnessBus at all.
Maybe @Def3nder or @Aircoookie could take a look at his comment on the NeoPixelBus github.