Post

Has anybody in my network set up local notes (Markdown files) with an Ollama RAG/model trained on such notes? So far, below is the best shot I found. I want to play around over Christmas break and wonder about the best approaches. I collect some ideas here: www.ssp.sh/brain/second.... #obsidian

Do you want an Obsidian Integration or how you want to trigger it? I set one up locally pulling in from Notion, with a custom frontend, and a Lance vectordb in the backend.

I use hybrid search + a reranker on top of Lance. Did some light relevant engineering and do a weighting based on the different fields (e.g. title, body, headings in the page). I did not do any query understanding because I know how to write my queries to have a good retrieval score.

How happy are you with the responses when you query? Are they helpful, just common sense, or super insightful?

For me the responses aren't the most important thing, but rather the bare results. I needed a better search to find my stuff. I would say the responses are all over the place, because my Notion often is very deep in a topic, where the smaller models just don't have any relevant knowledge