Does that require a unique id generated for each search request? assuming that should be from the frontend?

You can use the websocket pointer itself on the backend if you want.

.NET looks like : Dict<WebSocket, List<resultObj>> webSocketConnections

Right. But also from a streaming PoV in the frontend: how does that look? Have a bunch of products from X site (not ranked at all), have a bunch of products from Y site all come in sequentially. Been thinking of how to display them.

Right now I get all products from all sites then rank and classify and categorise them.

As you get the results send them out (using async methods). As they arrive auto-sort them according to default user preference which is probably sort-by-price. Users will notice the scrollbar has increased in size or some other visual cue.

hmm makes sense. I have some more thoughts on top of that in terms of exact product display UI

Gold.

Completely agree. It's definitely a bubble, but it's like the Dotcom or housing bubble. Just because it bursts doesn't mean it's going away, just means it was overmarketed and PR'd. Companies spent billions on foundational models and the hype was necessary for their B2B sales, although they haven't met that yet probably so the hype will continue for some time and Money will be spent for some time too for sure. Although I do think it will take much longer for adoption of AI robots. Main device will be phones and better phones and things attached or pairable with phones for the next decade atleast. IoT will also get a revamp for sure