Are the HDMI adapters you are using DisplayLink capable? If not, you'll need one of those to get multiple monitors. On my M2 MacBook I am using one of the Plugable 4K Docking Stations and I'm able to run three monitors through it. This is the one I've been using:
https://www.amazon.com/dp/B0779K9DG2
Without a hardware adapter that supports DisplayLink you're going to be out of luck getting more than one external monitor. Good luck!