Hi!
I’m trying to set up something similar. I have a strip that will fit behind (or maybe under) a long TV cabinet which I want to colour based on the dominant colours currently on screen.
So far to achieve this I use a cheap hdmi capture/passthrough card connected to a raspberry pi. This runs a python script which analyses the image and pulls out the dominant colours (I’ve found that simply resizing the image to {num_leds}px X 1px is both fast and a decent representation of the dominant colours).
Initially I then used the JSON API to send this data to WLED, however as you can imagine there is too much latency, especially as my WiFi is inconsistent!
I’m therefore trying to send the data via a serial connection between my Pi and the WLED controller (I have one of these: JIOTTY Technical Help - Jiotty Docs). I have had reasonable success using JSON over the serial connection, but this still isn’t the quickest. Instead I am now trying to send ambilight packets instead, but hitting an issue that it works for a few seconds, and then seems to just stop (see How to enable Adalight over serial? - #5 by richardw).
Anyway, I’m still hopeful I can get this working - it certainly feels like this sort of thing can be done without having a full Hyperion installation, but that remains to be seen.