Post

I feel like the llms.txt should be a Sphinx extension. Should help a lot when generating docs - I'd use it for sbert.net

Done! github.com/davidgasquez...

Perhaps a Langchain style sanitisation can be applied to remove all multi -, spaces etc. Can save a few tokens but more importantly improve inference