Rendered at 16:26:12 GMT+0000 (Coordinated Universal Time) with Cloudflare Workers.
trjordan 33 minutes ago [-]
I deeply love this idea of specialized LLMs for search. It's also extremely confusing to me how rough Google's entrance here is.
When I, a human, need an answer to anything moderately complex, it's unlikely that I get it on the first (pre-AI) round of google searching. Simple stuff, sure, but more likely I'll need to go 2-5 rounds. Maybe click a few links. Double-check my assumptions.
An LLM that can do that quickly seems like a slam dunk. I wonder what other problems benefit from that 10x-100x increase in context + 2-5 rounds with the LLM.
Waterluvian 11 minutes ago [-]
About 15 years ago I would sometimes spend hours on Google image search discovering childhood toys and filling in vague memories of locations or things. I tried this recently and it’s basically impossible. I actually get to the end of the search results in like 3 minutes and the quality is horrible now.
I think in a lot of ways Google peaked and is now on the decline into a profitable but much less relevant services company.
gwbas1c 13 minutes ago [-]
What kind of search do you mean?
For example, a couple of days ago I described a problem with my refrigerator's water dispenser to Google Gemini, and it told me exactly how to fix it. I then went looking for a video and fixed the thing in under 15 minutes. The only way that Gemini could have been better is if it linked to a video itself.
Do you mean search into less-well-known topics? Or something else?
gottagocode 22 minutes ago [-]
I know it can be a deep time sink, but I notice more and more how much deeper my understanding is of a certain problem/best-practice after developing the neuropathways involved in crawling between reddit, stack overflow, etc, to get to the proper solution. I love the instant answer from google ai, but I also notice an itch to purposefully force myself to ignore it when time allows.
tolugenius 31 minutes ago [-]
I guess someone who has used a search agent (or a dedicated subagent) can speak when I'd reach for a tool like this vs either just 1) a smaller general model or 2) a non-llm approach to the problem? Like it's interesting I'm just curious how a search agent compares to say a model with dedicated rag pipelines is that much different?
breadislove 27 minutes ago [-]
the issue with smaller general models (see at the charts) are way behind the frontier models when it comes to search. we've found that there is huge uplift of having a fast dedicated model. from our perspective, having a very good index is the biggest lever and then having a specialised model.
andai 18 minutes ago [-]
Article should probably explain what "Mixedbread Search" is.
breadislove 12 minutes ago [-]
Mixedbread Search is a multimodal & multilingual search product, where you can upload any kind of data and make it searchable. Its powered by Wholembed [1] v3, a late interaction retrieval model.
When I, a human, need an answer to anything moderately complex, it's unlikely that I get it on the first (pre-AI) round of google searching. Simple stuff, sure, but more likely I'll need to go 2-5 rounds. Maybe click a few links. Double-check my assumptions.
An LLM that can do that quickly seems like a slam dunk. I wonder what other problems benefit from that 10x-100x increase in context + 2-5 rounds with the LLM.
I think in a lot of ways Google peaked and is now on the decline into a profitable but much less relevant services company.
For example, a couple of days ago I described a problem with my refrigerator's water dispenser to Google Gemini, and it told me exactly how to fix it. I then went looking for a video and fixed the thing in under 15 minutes. The only way that Gemini could have been better is if it linked to a video itself.
Do you mean search into less-well-known topics? Or something else?
[1]: https://www.mixedbread.com/blog/wholembed-v3