@grgerwcwetwet: Recommending an open-source project: qiaomu-anything-to-notebooklm. Someone built a hardcore tool with Claude, and after seeing it, I just want to say: Knowledge management folks should definitely bookmark this. You can throw in any content—WeChat public accounts, YouTube, podcasts, PDFs, Word, Excel…
Summary
Recommending an open-source project qiaomu-anything-to-notebooklm, based on Claude to automatically organize multi-source content (WeChat public accounts, YouTube, PDFs, etc.) and generate podcasts, PPTs, mind maps, all through natural language operations.
View Cached Full Text
Cached at: 06/12/26, 06:55 AM
Recommend an open-source project: qiaomu-anything-to-notebooklm. Someone built a hardcore tool using Claude, and after seeing it, I can only say: knowledge management enthusiasts should definitely bookmark this. You can throw in any content—WeChat public accounts, YouTube, podcasts, PDFs, Word, Excel, ebooks—it automatically organizes everything and finally generates podcasts, PPTs, mind maps. The best part is it operates entirely through natural language, no coding required. https://github.com/joeseesun/qiaomu-anything-to-notebooklm…
joeseesun/qiaomu-anything-to-notebooklm
Source: https://github.com/joeseesun/qiaomu-anything-to-notebooklm
🎯 Anything → NotebookLM
Multi-source content smart processor: Anything → Podcast / PPT / Mind Map / Quiz
License: MIT (https://opensource.org/licenses/MIT) Python 3.9+ (https://www.python.org/downloads/) PRs Welcome (http://makeapullrequest.com) GitHub stars (https://github.com/joeseesun/qiaomu-anything-to-notebooklm/stargazers) GitHub forks (https://github.com/joeseesun/qiaomu-anything-to-notebooklm/network/members) GitHub issues (https://github.com/joeseesun/qiaomu-anything-to-notebooklm/issues) GitHub last commit (https://github.com/joeseesun/qiaomu-anything-to-notebooklm/commits/main)
Quick Start • Supported Formats • Usage Examples • Paywall Bypass • FAQ
✨ What is this?
A Claude Code Skill that turns anything into any format using natural language.
You: Turn this WeChat article into a podcast
AI: ✅ 8-minute podcast generated → podcast.mp3
You: Turn this paywalled article into a mind map
AI: ✅ Automatically bypassed paywall → Mind map generated
You: Turn this podcast (Xiaoyuzhou) into a PPT
AI: ✅ Auto-transcribed audio → 25-slide PPT generated
Core capability: Multi-source content acquisition (including paywall bypass) → Upload to Google NotebookLM (https://notebooklm.google.com/) → AI generates target format
🚀 Supported Content Sources (15+)
📱 Social & Media
- WeChat public accounts (MCP browser simulation)
- X/Twitter (tweets + long threads)
- YouTube videos (auto-extract subtitles)
- Podcasts (Xiaoyuzhou / Ximalaya / Bilibili)
🌐 Web Pages (including paywall bypass)
- 300+ paywalled sites (NYT/WSJ/FT/Economist…)
- Any public web page (news, blogs, docs)
- Search keywords (auto-summarize results)
📚 eBooks & Documents
- PDF (supports OCR for scanned documents)
- EPUB ebooks
- Markdown (.md)
- Plain text (.txt)
📄 Office Documents
- Word (.docx)
- PowerPoint (.pptx)
- Excel (.xlsx)
🖼️ Others
- Images (JPEG/PNG, auto OCR)
- Audio (WAV/MP3, auto transcription)
- ZIP archives (batch processing)
🛡️ Paywall Bypass
Core feature: Automatically detects and bypasses paywalls on 300+ paid news sites.
Bypass Strategy (6-level cascade)
Level 1: Proxy service (r.jina.ai / defuddle.md)
↓ Fail
Level 2: Site-specific Bot UA (Googlebot ~50 sites / Bingbot ~4 sites)
↓ Fail
Level 3: Generic bypass (UA spoofing + X-Forwarded-For + Referer spoofing + AMP + EU IP)
↓ Fail
Level 4: archive.today snapshot (auto CAPTCHA detection)
↓ Fail
Level 5: Google Cache
↓ Fail
Level 6: agent-fetch local tool
Supported Paid Sites (partial)
| Category | Sites |
|---|---|
| 🇺🇸 US Media | NYT, WSJ, Bloomberg, Washington Post, The Information, Forbes, WIRED, The New Yorker, The Atlantic, USA Today, Boston Globe, LA Times, Chicago Tribune, Seattle Times, MIT Tech Review, Foreign Affairs |
| 🇬🇧 UK Media | FT, The Times, The Telegraph, The Economist |
| 🇩🇪 German Media | Spiegel, Zeit, Sueddeutsche, FAZ, Handelsblatt |
| 🇫🇷 French Media | Le Monde, Le Figaro, Le Parisien |
| 🇦🇺 Australian Media | The Australian, SMH, The Age, Brisbane Times |
| 🇨🇳 Chinese Media | SCMP, Medium |
| 🌐 Others | Haaretz, NZ Herald, Statista, Quora |
Bypass Techniques (learned from Bypass Paywalls Clean (https://gitflic.ru/project/magnolia1234/bypass-paywalls-chrome-clean))
| Technique | Principle | Coverage |
|---|---|---|
| Googlebot UA + X-Forwarded-For | Search engine crawler whitelist, directly get full text | ~50 sites |
| Bingbot UA | Same, some sites more Bing-friendly | ~4 sites |
| Cookie clear + Referer spoofing | Clear metering cookies, spoof referrer from Google/Facebook/Twitter | Metered paywalls |
| AMP pages | AMP version paywall implementation is weaker | ~10 sites |
| JSON-LD extraction | Extract articleBody from embedded structured data in HTML | Universal |
| archive.today | Get saved content from web archive | Fallback |
🎨 What can be generated?
| Output Format | Use Case | Trigger Phrase Example |
|---|---|---|
| 🎙️ Podcast | Listen during commute | “Generate podcast”, “Make audio” |
| 📊 PPT | Team sharing | “Make a PPT”, “Generate slides” |
| 🗺️ Mind Map | Clarify structure | “Draw a mind map”, “Generate brain map” |
| 📝 Quiz | Self-assessment | “Generate quiz”, “Create questions” |
| 🎬 Video | Visualization | “Make a video” |
| 📄 Report | Deep analysis | “Generate report”, “Write a summary” |
| 📈 Infographic | Data visualization | “Make an infographic” |
| 📋 Flashcards | Memory reinforcement | “Make flashcards” |
⚡ Quick Start
Prerequisites
- ✅ Python 3.9+
- ✅ Git (built-in on macOS/Linux)
That’s all! Other dependencies are installed automatically with one command.
Installation (3 steps)
# 1. Clone into Claude skills directory
cd ~/.claude/skills/
git clone https://github.com/joeseesun/qiaomu-anything-to-notebooklm
cd qiaomu-anything-to-notebooklm
# 2. One-click install all dependencies
./install.sh
# 3. Configure MCP as prompted, then restart Claude Code
First Use
# NotebookLM authentication (only once)
notebooklm login
notebooklm list # Verify success
# Environment check (optional)
./check_env.py
Podcast Transcription Configuration (Optional)
To use Xiaoyuzhou / Ximalaya / Bilibili transcription, configure Get Notes API:
export GETNOTE_API_KEY="your_api_key"
export GETNOTE_CLIENT_ID="your_client_id"
💡 Usage Examples
Scenario 1: Paywalled Article → Podcast
You: Turn this The Information article into a podcast
https://www.theinformation.com/articles/...
AI auto-executes:
✓ Detect paywall → Bypass with Googlebot UA
✓ Get full article content
✓ Upload to NotebookLM
✓ Generate podcast
✅ Result: /tmp/article_podcast.mp3
Scenario 2: Podcast (Xiaoyuzhou) → PPT
You: Turn this Xiaoyuzhou podcast into a PPT
https://xiaoyuzhoufm.com/episode/...
AI auto-executes:
✓ Transcription via Get Notes API (2-5 minutes)
✓ Upload transcript to NotebookLM
✓ Generate PPT
✅ Result: /tmp/podcast_slides.pdf (25 slides)
Scenario 3: eBook → Deep Analysis
You: Deeply analyze this book /Users/joe/Books/sapiens.epub
AI auto-executes:
✓ Extract full EPUB text
✓ Upload to NotebookLM
✓ Generate 12 questions (3 progressive rounds: overview → deep dive → synthesis)
✓ Ask round by round, later rounds benefit from previous conversation context
✓ Output structured JSON
✅ Result: /tmp/sapiens_analysis.json (12 Q&As including core points, argument breakdown, contradictions, cognitive shifts)
Scenario 4: X/Twitter Thread → Mind Map
You: Turn this tweet thread into a mind map
https://x.com/user/status/123...
AI auto-executes:
✓ Proxy cascade to fetch tweet content (including full thread)
✓ Upload to NotebookLM
✓ Generate mind map
✅ Result: /tmp/tweet_mindmap.json
Scenario 5: WeChat Article → Feishu Document (Deep Analysis)
You: Deeply analyze this WeChat article and write to Feishu
https://mp.weixin.qq.com/s/abc123
AI auto-executes:
✓ MCP browser simulation to scrape WeChat article
✓ Upload to NotebookLM
✓ Generate 10 questions and recursively ask
✓ Format as Feishu Markdown
✓ Auto-create Feishu document
✅ Result: Feishu document created (with full Q&A)
🎯 Core Features
🧠 Smart Recognition
Automatically determines input type, no manual specification needed
https://mp.weixin.qq.com/s/xxx → WeChat public account
https://xiaoyuzhoufm.com/episode/xxx → Xiaoyuzhou podcast
https://x.com/user/status/xxx → X/Twitter
https://youtube.com/watch?v=xxx → YouTube video
/path/to/file.epub → EPUB ebook
"Search 'AI trends'" → Search query
🛡️ Auto Paywall Bypass
No manual handling needed, auto-detect and bypass
Detect paywall → Choose best strategy → Get full content
〈________Fully automatic________〈
🚀 Fully Automated Processing
From acquisition to generation, all in one go
Input → Acquire → Convert → Upload → Generate → Download
〈___________Fully automatic___________〈
🌐 Multi-Source Integration
Supports mixing multiple content sources
Paywalled article + YouTube video + EPUB + Podcast → Comprehensive report
📦 Technical Architecture
┌──────────────────────────────────────────┐
│ User natural language input │
│ "Turn this paywalled article into a │
│ podcast https://..." │
└──────────────────┬───────────────────────┘
│
▼
┌──────────────────────────────────────────┐
│ Claude Code Skill │
│ • Smart content source type recognition │
│ • Auto-call corresponding tools │
└──────────┬───────────────────────────────┘
│
┌──────┴───────┐
│ │
▼ ▼
┌──────────┐ ┌──────────────┐ ┌──────────┐ ┌──────────┐
│WeChat MCP│ │Paywall Bypass│ │Podcast │ │markitdown│
│Browser │ │6-level │ │Transcrip │ │File │
│Simulation│ │cascade │ │Get Notes │ │Conversion│
└─────┬────┘ └──────┬───────┘ │API │ └─────┬────┘
│ │ └─────┬────┘ │
└──────────────┴─────────────────┴──────────┘
│
▼
┌────────────────────────┐
│ NotebookLM API │
│ • Upload content source │
│ • AI generates target │
│ format │
└───────────┬────────────┘
│
▼
┌────────────────────────┐
│ Generated files │
│ .mp3 / .pdf / .json │
└────────────────────────┘
📂 Project Structure
qiaomu-anything-to-notebooklm/
├── SKILL.md # Skill definition file
├── README.md # This file
├── main.py # Main entry: CLI smart processor
├── install.sh # One-click install script
├── check_env.py # 13-item environment check
├── package.sh # Package and share script
├── requirements.txt # Python dependencies
├── LICENSE # MIT
├── scripts/
│ ├── fetch_url.sh # URL fetching + paywall bypass (6-level cascade)
│ └── get_podcast_transcript.py # Podcast/video transcription (Get Notes API)
├── wexin-read-mcp/ # WeChat public account MCP server
│ └── src/
│ ├── server.py # MCP entry
│ ├── scraper.py # Playwright browser simulation
│ └── parser.py # HTML parsing
└── feishu-read-mcp/ # Feishu document MCP server
└── src/
├── server.py # MCP entry
├── scraper.py # Feishu document scraping
├── parser.py # HTML → Markdown
└── image_handler.py # Image processing
🔧 Advanced Usage
Deep Analysis Mode
python main.py https://example.com/article --deep-analysis
# Auto-generates 12 questions (3 progressive rounds: overview → deep dive → synthesis), asks round by round, outputs structured JSON
Three-round progressive strategy:
| Round | Questions | Purpose | Example |
|---|---|---|---|
| Round 1: Overview & Framework | 4 | Build overall understanding | Summarize theme, list structure, extract core arguments, dig out disruptive content |
| Round 2: Deep Dive | 5 | Dive into details | Deconstruct argument logic, analyze contradictions, extract core insights, offer sharp criticism |
| Round 3: Synthesis & Reflection | 3 | Cognitive upgrade | Biggest cognitive shift, action guide, recommendation reason |
NotebookLM maintains context within the same session, so later round questions automatically benefit from earlier answers, forming a true “progressive” deep analysis.
Feishu Document Output
python main.py ./book.epub --deep-analysis --to-feishu
# After deep analysis, automatically create a Feishu document
Batch Processing
Turn all these articles into podcasts:
1. https://mp.weixin.qq.com/s/abc123
2. https://www.wsj.com/articles/...
3. /Users/joe/notes.md
🐛 Troubleshooting
MCP Tool Not Found
python ~/.claude/skills/qiaomu-anything-to-notebooklm/wexin-read-mcp/src/server.py
cd ~/.claude/skills/qiaomu-anything-to-notebooklm/wexin-read-mcp
pip install -r requirements.txt
playwright install chromium
NotebookLM Authentication Failed
notebooklm login # Re-login
notebooklm list # Verify
Paywall Bypass Failed
Some hard paywalled sites (e.g., The Information) do not send content server-side; an archive.today snapshot is needed. The script will auto-detect and prompt:
⚠️ archive.ph needs human verification.
Browser opened automatically. Please complete the verification and retry.
Environment Check
./check_env.py # 13 comprehensive checks
./install.sh # Reinstall
❓ FAQ
Q: Which languages are supported? A: NotebookLM supports multiple languages; Chinese and English work best.
Q: Who voices the podcast? A: Google AI voice synthesis. English has two AI hosts in conversation; Chinese is a single narrator.
Q: Is paywall bypass legal? A: This tool is for personal study and research only. The technique is based on search engine whitelists (Googlebot/Bingbot) and does not crack any encryption. We recommend supporting quality news media by purchasing subscriptions.
Q: Content length limits? A:
- Shortest: ~500 words
- Longest: ~500,000 words
- Recommended: 1000-10,000 words for best results
Q: Why is MCP needed? A: WeChat public accounts have anti-scraping measures; MCP uses Playwright browser simulation to bypass. Other content sources (web pages, YouTube, PDF) do not require MCP.
Q: Which platforms are supported for podcast transcription? A: Through Get Notes API, supports Xiaoyuzhou, Ximalaya, Bilibili videos. YouTube is handled directly by NotebookLM.
🙏 Acknowledgments
- Google NotebookLM (https://notebooklm.google.com/) - AI content generation
- Microsoft markitdown (https://github.com/microsoft/markitdown) - File conversion
- Bypass Paywalls Clean (https://gitflic.ru/project/magnolia1234/bypass-paywalls-chrome-clean) - Paywall bypass strategy reference
- wexin-read-mcp (https://github.com/Bwkyd/wexin-read-mcp) - WeChat scraping
- notebooklm-py (https://github.com/teng-lin/notebooklm-py) - NotebookLM CLI
📄 License
MIT License - For personal study and research only
If you find it useful, please give it a ⭐ Star!
Made with ❤️ by Joe (https://github.com/joeseesun) · Twitter @vista8 (https://x.com/vista8) · WeChat public account「向阳乔木推荐看」
Similar Articles
joeseesun/qiaomu-anything-to-notebooklm
一个开源工具,利用Claude Code Skill和Google NotebookLM将多种来源的内容(网页、PDF、音频、视频等)转换为播客、PPT、思维导图等格式,并内置付费墙绕过功能。
@wsl8297: Found another capable open-source alternative to Google NotebookLM: Open Notebook. Privately deployable, with all data firmly in your own hands, giving you greater peace of mind on privacy. It supports 16+ mainstream AI model providers, allows uploading materials like PDFs, web pages, videos, and audio, and generates structured…
Introduces an open-source tool called Open Notebook, a privacy-focused alternative to Google NotebookLM, supporting private deployment and multi-model integration, capable of processing various content formats and generating podcasts.
@GenhuiP78950: Open-sourced my AI tools from the past six months. Not a big project, just scripts I use daily – transcribing Douyin/Bilibili videos, podcast-to-text, WeChat public account articles, industry news scanning… 11 in total. Used them privately, now unified with install scripts and docs.
Open-sourced a collection of 11 AI tool scripts for collecting and transcribing content from multiple channels like Douyin, Bilibili, and WeChat public accounts, making it easy to build a personal knowledge base. Supports direct installation by agents such as Claude Code, Codex, etc.
@NFTCPS: Someone used Claude to build a content nuke — I can't in good conscience not mention it. Just throw anything in — WeChat public accounts, YouTube, podcasts, PDFs, Word, Excel, ebooks — and it directly spits out podcasts, PPTs, mind maps. The craziest part? 300+ paywalled sites, NYT, FT, The Economist, the paywall is treated like air. All in natural language, no coding needed. If you're a learner, content enthusiast, or knowledge management fan, you'll regret not bookmarking this.
An open-source tool that uses Claude to convert various content types such as WeChat public accounts, YouTube, podcasts, PDFs, etc., into podcasts, PPTs, and mind maps, and supports bypassing paywalls of 300+ paid websites.
@NFTCPS: I was really awakened by an open-source project today. 14.5k stars, directly pulling NotebookLM from 'usable' to 'capable', and at pipeline level. I've long been annoyed with the web version: upload PDFs wait, generate audio wait, download wait, all time fed to progress bars. If you want to batch produce content, it's basically self-torture.…
notebooklm-py is an open-source project that provides a Python API and CLI for NotebookLM, supporting batch processing, multi-format export, and AI agent integration, greatly improving content creation efficiency.