web-scraping

Tag

Cards List
#web-scraping

@itsolelehmann: The top Hermes integrations to give your agent superpowers: 1. Firecrawl Basically web search built for agents. It's be…

X AI KOLs Following · yesterday

A curated list of the top integrations for the Hermes AI agent, including Firecrawl, Browserbase, Google Workspace, Reddit, YouTube, Discord, GitHub, Stripe, Bland/Twilio, Apify, Readwise, Granola/Fathom, and Obsidian, to give the agent superpowers for web search, interaction, productivity, and research.

0 favorites 0 likes
#web-scraping

@hasantoxr: I'm done paying $500 a month for anti-detect browsers after finding this. It's called CloakBrowser. A stealth Chromium …

X AI KOLs Timeline · yesterday

The article introduces CloakBrowser, an open-source stealth Chromium-based browser designed to bypass bot detection systems like reCAPTCHA and Cloudflare Turnstile. It claims to offer superior stealth capabilities by patching the C++ source code rather than injecting JavaScript, positioning itself as a free alternative to expensive commercial anti-detect browsers.

0 favorites 0 likes
#web-scraping

@VincentLogic: Share a powerful tool that can 'one-click clone' any website into code! ai-website-cloner-template Simply put: give it a URL, and AI helps you reverse-engineer it, directly generating a clean Next.js codebase. What makes it powerful? Extremely high fidelity: It doesn’t just copy the surface; the AI automatically takes screenshots...

X AI KOLs Timeline · 2d ago

Introduces a tool named ai-website-cloner-template that uses AI to reverse-engineer any website into a high-quality Next.js codebase, supporting mainstream AI coding assistants.

0 favorites 0 likes
#web-scraping

A modern feed reader (2024)

Lobsters Hottest · 2d ago Cached

The author examines the decline of RSS feeds due to scraping and interference, arguing that modern feed readers must integrate alternative syndication methods to remain relevant.

0 favorites 0 likes
#web-scraping

@thisguyknowsai: This is why GitHub is undefeated... A developer built a headless browser that makes Chrome look obese. It's called Obsc…

X AI KOLs Timeline · 2d ago

A developer built Obscura, an open-source headless browser engine in Rust designed specifically for AI agents, web scraping, and automation, claiming it's more lightweight than Chrome.

0 favorites 0 likes
#web-scraping

@vista8: An open-source browser project that bypasses all major anti-bot detection: CloakBrowser. It is said to bypass all major anti-bot measures, such as Cloudflare. Directly modified from Chromium C++ source code, it changes 57 fingerprinting details at compile time. As the saying goes, the measure is high, the devil is higher, hahaha. Github…

X AI KOLs Timeline · 2d ago Cached

CloakBrowser is an open-source browser project directly modified from Chromium C++ source code, bypassing anti-bot measures like Cloudflare by changing 57 fingerprinting details at compile time.

0 favorites 0 likes
#web-scraping

Markdown browser for LLMs

Reddit r/LocalLLaMA · 2d ago

The author introduces TextWeb, an open-source tool that renders web pages as markdown for LLMs instead of using expensive vision models, featuring CLI and MCP server support.

0 favorites 0 likes
#web-scraping

@heynavtoor: THE VIRTUAL ASSISTANT INDUSTRY IS DONE. Two students at ETH Zurich shipped an MVP in four days. Now AI controls their C…

X AI KOLs Timeline · 3d ago Cached

Browser-Use, an open-source framework for AI-driven browser automation developed by ETH Zurich students, challenges the traditional RPA industry by offering free, self-healing capabilities that mimic human interaction without relying on brittle HTML parsing.

0 favorites 0 likes
#web-scraping

Web Speed

Product Hunt · 3d ago

Web Speed is a new product launch aiming to reduce the cost of AI agents by 90% by eliminating token tax in web interactions.

0 favorites 0 likes
#web-scraping

Tried 5 agent platforms for daily competitor monitoring, here are the 2 that actually survived a month

Reddit r/AI_Agents · 4d ago

The author compares five AI agent and automation platforms (n8n, Browse AI, Apify, Make, MuleRun) for competitor monitoring, concluding that MuleRun and n8n were the most reliable for their specific use case.

0 favorites 0 likes
#web-scraping

Today I declare AI Web Agent free again

Reddit r/AI_Agents · 4d ago

The author releases StealthFox, an open-source Firefox fork designed to bypass anti-bot systems by generating unique, consistent browser fingerprints at the C++ level for AI web agents.

0 favorites 0 likes
#web-scraping

I built a TikTok data API (NO AUTH) - profiles, videos, comments, search, hashtags, and social graph as clean JSON

Reddit r/AI_Agents · 4d ago

The author announces the addition of TikTok support to Scavio AI, an online search API for AI agents that provides structured JSON data for profiles, videos, comments, and social graphs without requiring authentication.

0 favorites 0 likes
#web-scraping

Show HN: Mochi.js: bun-native high-fidelity browser automation library

Hacker News Top · 4d ago Cached

Mochi.js is a new open-source browser automation library built natively for the Bun runtime, designed to bypass detection mechanisms with relational consistency, native Chromium fetching, and behavioral synthesis.

0 favorites 0 likes
#web-scraping

@kylejeong: OpenClaw can use Autobrowse to create and iteratively improve a Skill for any workflow. In this Craigslist extraction e…

X AI KOLs Timeline · 4d ago Cached

OpenClaw uses Autobrowse to iteratively improve workflows, achieving a 68% speed increase and 91% cost savings in 5 iterations on a Craigslist data extraction task. The AI agent autonomously discovered an exposed endpoint to further optimize page navigation.

0 favorites 0 likes
#web-scraping

@simplifyinAI: This python library scrapes any website while bypassing every bot protection on the internet. It rotates fingerprints, …

X AI KOLs Timeline · 5d ago

A Python library that scrapes websites while bypassing bot protections like Cloudflare and Akamai by rotating fingerprints, mimicking browser headers, and automatically handling CAPTCHAs. It uses Headless Chromium, Playwright, proxy rotation, and is fully open-source.

0 favorites 0 likes
#web-scraping

@DeRonin_: Do you understand what Browserbase just open-sourced??? an agent that learns any website once, then does the job 10x ch…

X AI KOLs Following · 5d ago

Browserbase open-sourced Autobrowse, an agentic web browsing tool that learns website structures through iterative exploration and saves discovered patterns as reusable markdown skills, dramatically reducing time and cost for repeated web automation tasks.

0 favorites 0 likes
#web-scraping

@servasyy_ai: https://x.com/servasyy_ai/status/2052549006170169527

X AI KOLs Timeline · 5d ago Cached

This article demonstrates how to automate cross-border e-commerce product selection using XCrawl tools and an AI agent, compressing manual work that originally took hours down to 3 minutes, and calculating profit by comparing data from Amazon and 1688.

0 favorites 0 likes
#web-scraping

@jakevin7: OpenCLI now has a killer feature—turn any webpage into Markdown with one command: opencli web read --url <any-url>

X AI KOLs Following · 2026-04-22 Cached

OpenCLI adds a one-command feature that converts any webpage to Markdown via DOM heuristics and Turndown.

0 favorites 0 likes
#web-scraping

@NFTCPS: Time to retire Headless Chrome! Someone built a Rust-based headless browser engine for AI agents and crawlers—Obscura—whose performance leaves Chrome in the dust: ① only 30 MB of RAM (Chrome eats several GB) ②…

X AI KOLs Timeline · 2026-04-22 Cached

Obscura is a new Rust-based headless browser engine targeting AI agents and crawlers, offering 30 MB memory usage, 85 ms startup, and CDP compatibility with Puppeteer/Playwright.

0 favorites 0 likes
#web-scraping

@ycombinator: LLMs are great for human in the loop applications, but fail at deterministic developer tasks. @interfaze_ai is a new AI…

X AI KOLs Following · 2026-04-20 Cached

Interfaze AI introduces a specialized model that surpasses general LLMs on deterministic developer tasks including OCR, object detection, web scraping, speech-to-text, and classification.

0 favorites 0 likes
Next →
← Back to home

Submit Feedback