What's the best tool for offline Wikipedia RAG at the moment?

Reddit r/LocalLLaMA Tools

Summary

The user asks for recommendations on offline Wikipedia RAG tools for use with AI models like Qwen, noting abandoned projects and seeking community input.

Theoretical use case: I have a compressed version of wikipedia, and some function or tool fooRAG. Then I set my system prompt (or make a skill, or hook, etc.) to include "You can search wikipedia with the fooRAG tool like so...". Then in whatever harness I'm using I ask Qwen "List every character in the play Hamlet", and it uses the tool to pull and read the wikipedia page for Hamlet. So far I've just found abandoned projects— this is the sort of question that's good to poll the community for. Definitely something I might take a crack at if there aren't good options available...
Original Article

Similar Articles