@CycleDecoded: 搞 AI 向量数据库和 RAG 的兄弟们可以少走半年弯路了！ GitHub 上爆火的这个项目，直接把“实时数据 + 向量检索 + LLM 管道”给合体了，写 30 行 Python 代码就能秒搭一个企业级 RAG 系统，完全不用去搞各种复…
摘要
Pathway 团队开源的 llm-app 是一个用于构建企业级 RAG 系统的框架，支持实时数据同步、内置向量检索，并配有现成的云模板，GitHub 上已获 5.9 万+ Star。
查看缓存全文
缓存时间: 2026/08/03 01:36
搞 AI 向量数据库和 RAG 的兄弟们可以少走半年弯路了！
GitHub 上爆火的这个项目，直接把“实时数据 + 向量检索 + LLM 管道”给合体了，写 30 行 Python 代码就能秒搭一个企业级 RAG 系统，完全不用去搞各种复杂的向量数据库配置！
这是 Pathway 团队开源的 llm-app（GitHub 斩获 5.9 万+ Stars，MIT 协议开源）。它最离谱的地方在于“全自动实时同步”——你的 Google Drive、SharePoint、S3 或数据库里文件一改，AI 知识库瞬间自动刷新，根本不需要手动重新跑嵌入或者手动触发同步！
核心杀手锏：
零向量库门槛：内置内存向量索引，不依赖 Pinecone 等第三方服务，几行代码跑通。
实时热更新数据：完美对接 Kafka、PostgreSQL、SharePoint，源头数据变了 AI 马上知道。
开箱即用云模板：预置大量 RAG 与企业搜索模板，直接打成 Docker 镜像就能上线。
商业无忧：采用 MIT 宽松协议，不管是自己玩还是做公司商业项目都能随意搞。
还在等啥，自己去看。
传送门：https://github.com/pathwaycom/llm-app…
pathwaycom/llm-app
Source: https://github.com/pathwaycom/llm-app
Pathway Live Data Framework AI Pipelines
The Pathway Live Data Framework’s AI Pipelines allow you to quickly put in production AI applications that offer high-accuracy RAG and AI enterprise search at scale using the most up-to-date knowledge available in your data sources. It provides you ready-to-deploy LLM (Large Language Model) App Templates. You can test them on your own machine and deploy on-cloud (GCP, AWS, Azure, Render,…) or on-premises.
The apps connect and sync (all new data additions, deletions, updates) with data sources on your file system, Google Drive, Sharepoint, S3, Kafka, PostgreSQL, real-time data APIs. They come with no infrastructure dependencies that would need a separate setup. They include built-in data indexing enabling vector search, hybrid search, and full-text search - all done in-memory, with cache.
Application Templates
The application templates provided in this repo scale up to millions of pages of documents. Some of them are optimized for simplicity, some are optimized for amazing accuracy. Pick the one that suits you best. You can use it out of the box, or change some steps of the pipeline - for example, if you would like to add a new data source, or change a Vector Index into a Hybrid Index, it’s just a one-line change.
| Application (template) | Description |
|---|---|
Question-Answering RAG App | Basic end-to-end RAG app. A question-answering pipeline that uses the GPT model of choice to provide answers to queries to your documents (PDF, DOCX,…) on a live connected data source (files, Google Drive, Sharepoint,…). You can also try out a demo REST endpoint. |
Live Document Indexing (Vector Store / Retriever) | A real-time document indexing pipeline for RAG that acts as a vector store service. It performs live indexing on your documents (PDF, DOCX,…) from a connected data source (files, Google Drive, Sharepoint,…). It can be used with any frontend, or integrated as a retriever backend for a Langchain or Llamaindex application. You can also try out a demo REST endpoint. |
Multimodal RAG pipeline with GPT4o | Multimodal RAG using GPT-4o in the parsing stage to index PDFs and other documents from a connected data source files, Google Drive, Sharepoint,…). It is perfect for extracting information from unstructured financial documents in your folders (including charts and tables), updating results as documents change or new ones arrive. |
Unstructured-to-SQL pipeline + SQL question-answering | A RAG example which connects to unstructured financial data sources (financial report PDFs), structures the data into SQL, and loads it into a PostgreSQL table. It also answers natural language user queries to these financial documents by translating them into SQL using an LLM and executing the query on the PostgreSQL table. |
Adaptive RAG App | A RAG application using Adaptive RAG, a technique developed by Pathway to reduce token cost in RAG up to 4x while maintaining accuracy. |
Private RAG App with Mistral and Ollama | A fully private (local) version of the question_answering_rag RAG pipeline using Pathway Live Data Framework, Mistral, and Ollama. |
Slides AI Search App | An indexing pipeline for retrieving slides. It performs multi-modal of PowerPoint and PDF and maintains live index of your slides.“ |
Video RAG with TwelveLabs | A RAG pipeline over video. It uses TwelveLabs Pegasus to turn videos into rich text descriptions and Marengo multimodal embeddings to index them, so you can ask questions about your videos on a live connected data source (files, Google Drive,…). |
How do these AI Pipelines work?
The apps can be run as Docker containers, and expose an HTTP API to connect the frontend. To allow quick testing and demos, some app templates also include an optional Streamlit UI which connects to this API.
The apps rely on the Pathway Live Data Framework for data source synchronization and for serving API requests (Pathway is a standalone Python library with a Rust engine built into it). They bring you a simple and unified application logic for back-end, embedding, retrieval, LLM tech stack. There is no need to integrate and maintain separate modules for your Gen AI app: Vector Database (e.g. Pinecone/Weaviate/Qdrant) + Cache (e.g. Redis) + API Framework (e.g. Fast API). Pathway’s default choice of built-in vector index is based on the lightning-fast usearch library, and hybrid full-text indexes make use of Tantivy library. Everything works out of the box.
Getting started
Each of the App templates in this repo contains a README.md with instructions on how to run it.
You can also find more ready-to-run code templates on the Pathway website.
Some visual highlights
Effortlessly extract and organize table and chart data from PDFs, docs, and more with multimodal RAG - in real-time:
(Check out Multimodal RAG pipeline with GPT4o to see the whole pipeline in the works. You may also check out the Unstructured-to-SQL pipeline for a minimal example that works with non-multimodal models as well.)
Automated real-time knowledge mining and alerting:
(Check out the Alerting when answers change on Google Drive app example.)
Do-it-Yourself Videos
▶️ An introduction to building LLM apps with Pathway Live Data Framework - by Jan Chorowski
▶️ Let’s build a real-world LLM app in 11 minutes - by Pau Labarta Bajo
Troubleshooting
To provide feedback or report a bug, please raise an issue on our issue tracker.
Contributing
Anyone who wishes to contribute to this project, whether documentation, features, bug fixes, code cleanup, testing, or code reviews, is very much encouraged to do so. If this is your first contribution to a GitHub project, here is a Get Started Guide.
If you’d like to make a contribution that needs some more work, just raise your hand on the Pathway Discord server (#get-help) and let us know what you are planning!
Supported and maintained by
相似文章
@ando_w: https://x.com/ando_w/status/2075468963098546520
本文介绍如何将单轮RAG升级为Agentic RAG，通过让LLM自主决定多次检索和调用工具，解决复合问题的多步推理。提供了基于Qwen3.7-Max的代码示例和实现思路。
@sitinme: Github 30k star，不用向量数据库也能做 RAG，而且准确率还更高！ 做 RAG 的人应该都有过这种体验：向量数据库返回的内容“看起来相关”，但就是不是你要的那个答案。 特别是处理合同、财报、技术手册这类长文档的时候，你问“第…
介绍一个GitHub上30k star的开源项目，通过推理而非向量数据库实现RAG，号称准确率更高，解决了向量检索中相似不等于相关的问题。
@Ryrenz: 兄弟们，又挖到一个宝藏课程：7 周从零搭出一套生产级 RAG 系统 GitHub 上 7.7k stars，全程动手写代码，不是幻灯片课 市面上的 RAG 教程大多直奔向量检索，demo 能跑，但是上线就崩。 这门课走的是公司里真实的路径…
一个GitHub上7.7k stars的7周课程，从零搭建生产级RAG系统，涵盖Docker、FastAPI、混合检索、LangGraph agentic RAG和Telegram bot，全程动手写代码。
@seclink: 冷知识，RAG 技术的演进路径 ① 2020 — 基础 RAG（解决"知识不在模型里"） 起点是 Lewis 等人的 RAG：DPR 稠密检索 + 向量相似度 + 生成。它第一次让 LLM 能"外接知识库"，缓解幻觉和时效性问题。但这代是…
科普了RAG技术从2020年基础RAG到2025-2026年自主智能体+强化学习的演进路径，涵盖检索精度提升、反思纠偏、图谱增强、路由优化与Agentic RAG等方向，并总结了各阶段代表性工作与痛点。
@mate_mattt: 做了一套真实可运行的 RAG 项目 和 Notebook RAG 实战课，对 RAG 进行像素级拆解： Markdown 切分 → FTS5 / BM25 → Embedding 向量检索 → 混合召回 RRF → Cross-Encod…
这是一个从零学习本地RAG检索核心的实战项目，包含Notebook和真实可运行代码，覆盖Markdown切分、BM25、Embedding向量检索、混合召回RRF、Cross-Encoder重排等完整流程，并配有评测指标。