Simon Willison on Mythryl: “Seems like that would work well to me”

This is a neat new variant on RAG - no vectors, not even full-text search, instead showing the model a header hierarchy and giving it a tool to read the relevant sections My notes here: simonwillison.net/2024/Dec/6/r...

simonwillison.netRoaming RAG – make the model find the answersNeat new RAG technique (with a snappy name) from John Berryman: > The big idea of Roaming RAG is to craft a simple LLM application so that the LLM assistant …

John Berryman@jnbrymn.bsky.social

Tired of wrestling with complex RAG pipelines? 🚀 Enter Roaming RAG: a simpler way to make your LLMs find answers in well-structured docs. No vector databases, no headaches—just rich, structured context. 👉 Read how it works: arcturus-labs.com/blog/2024/11...

arcturus-labs.comRoaming RAG – Make the Model Find the Answers - Arcturus LabsRoaming RAG offers a fresh take on Retrieval-Augmented Generation, letting LLMs navigate well-structured documents like a human—exploring outlines and diving into sections to find answers. Forget comp...

Jerome Etienne #AI

@jerome-etienne.bsky.social

6 Dec 2024

I got similar problem, but my solution is more hierarchic: - tool: fileSearch(semanticQuery) => list of files - tool: fileTableOfContent(filePath) => toc in markdown in list of section - tool: getSection(filePath, sectionName) => section text i would appreciate your opinion. What do you think ?

Post