Yes, o1 does this internally, and there's agentic AI systems already doing better than singular AIs in fields like writing, where you assign each AI system a role like "writer" or "editor" or "marketing" and they discuss among themselves.
Yeah, GPT is learning from GPT, which is extremely disappointing.
Like I'll try to find the top burgers in midtown. Perplexity or ChatGPT online searching will always find "Top 10 Burgers in Midtown" by https://nycreviewed.com/ (their SSL certificate isn't even valid). But this itself is a GPT-generated list, and their list isn't even in midtown.
So now I end up with a list of 10 burger places that aren't in midtown.
Ithy kinda solves this by utilizing multiple search engines and LLMs, so spam sites like this are more likely to get filtered out somewhere in the pipeline.
I asked the LLM to explain why it's filtering out "keto diet cures cancer", and just the act of asking it to explain it, makes it work again. Interesting...
That's a good idea! I have a feeling that Perplexity and ChatGPT are doing something similar, since common questions I'd ask like "top movies this year" will be answered nearly-instantaneously, way faster than GPT-4o could have done on its own.
The only explanation for this is that so many users ask certain questions, they cache the response and return the cached answer.
I'd love to do this for Ithy, but it'll be a while before I get the scale of ChatGPT/Perplexity that's needed for this...
already mentioned in another comment by me but this would/could be a primo use-case of Cloudflare AI gateway. i'm not related/affiliated with them at all, just a user/dev with very little traffic thinking it might help someone with a lot of it
Yeah the strength of Ithy isn't really in puzzles or math.
It's more of just a better search engine. Use it for stuff you'd Google. Offline LLMs are always going to have a better price-performance ratios than RAGs like this or Perplexity.
Update 2:30 PM ET: Back up (for now). Still waiting for Anthropic and Gemini quota increase requests, so those have been migrated to GPT-4o for now. Running on 2 VPCs, in the process of launching 2 more.
Confident that I can increase the daily limits by EOD once everything's more stable.
I'm just applying this theory to online search.