Install WLED remotely using AWS IoT

Context: I am just getting started with my new smart home project and this is my first IoT project.

I am planning to install a bunch of LED strips in my new home and want to use WLED to control them.
In future I would probably also build some other use cases (smart switches using relays, etc.) using ESP32 boards and maybe some raspberry pi(s).
For obvious aesthetic reasons, I would want to hide the modules in places which would by design be inconvenient to access (think in wall switch boards etc.).

I want the ability to

  1. Quickly on-board new devices and install WLED or some other firmware
  2. Have a central dashboard where I can monitor vitals, logs, firmware running, etc. for all the devices
  3. Push further firmware updates (latest WLED binaries or whatever else needed) via OTA without the need to physically take out the device unless something really goes wrong.

I was looking at options and found platforms like AWS IoT Device Management, FreeRTOS and similar solutions from Azure.
I am also open to self host any open source options if available which provide similar functionalities or any paid solution(Not too expensive though) like AWS IoT.
I am open to any other ideas as well.

Has anyone here in the community done something like this already? or what I am asking for is too much for a personal project?