Tag
该论文提出一个 141M 参数的编码器式 PII 检测模型，使用来自 77 个公共数据集、按统一上下文检测标准重新标注的 112 万条样本训练，在 AI4Privacy 和 Nemotron-PII 基准上以更低的 GPU 内存和 2–10 倍吞吐量取得领先召回率。
Elorian 发布首个视觉思考模型 Glimpse，能够对图像和视频进行推理，理解动作与变化，并有望自动化机器人遥操作数据的标注流程。
Doctors and lawyers are increasingly taking high-paying gig work (~$400/hour) annotating and reviewing data for AI models, as companies seek domain-expert input to improve model quality in specialized fields.
A thread arguing that AI training data is a uniquely perishable product that loses value once models master a task at around 70% accuracy, fueling a hot market that minted young billionaires even as the largest labs bring data creation in-house.
Goldsmith, an agentic annotation pipeline presented in an arXiv paper, converts small expert-annotated gold sets into structured annotation definitions optimized via an executable loss-guided loop, outperforming direct rewriting, OPRO, APE, and PromptBreeder.
StayCharted launches on Product Hunt as a no-code tool that lets teams train AI on their own custom categories by uploading already-sorted rows or photos, then automatically classifies support tickets, expense lines, surveys, and product images with human review for uncertain results.
OpenAI is using hundreds of contractors to read real users' ChatGPT prompts for model improvement, raising privacy concerns as prompts may include sensitive personal information.
GPT-6 Astra can automatically identify and label various elements in basketball footage, such as players and referees, potentially making manual data labeling obsolete.
Roboflow announces that integrating Astra for data labeling in vision AI products reduces time and cost to almost zero, potentially unblocking millions of products. The update highlights advancements where AI models like GPT-6 Astra can easily distinguish between similar visual categories such as sports players.
Amazon is discontinuing its crowdsourced work platform Mechanical Turk, which has been widely used for AI training data, due to declining usage and the rise of more efficient data labeling services.
Micro1, an AI data startup, has reached a $500M gross annual run rate in eight months due to high demand for AI training data, though it remains smaller than competitors like Mercor and Handshake.
This Forbes article reveals that U.S. data-labeling startups like Surge AI and Mercor are secretly selling high-quality training data to Chinese AI labs, helping China close the gap with American AI despite U.S. chip restrictions. The piece highlights the overlooked role of data infrastructure in the AI arms race and the regulatory blind spot around exporting proprietary data.
Enterprise AI often underestimates the work behind data operations, from labeling to governance, which is critical for scaling.
Introduces the RE-AD framework that uses LLMs to provide real-time validation of data labeling quality, achieving 82% error acceptance and fix rate in production.
A curated GitHub repository listing data labeling tools across various data types, maintained by HumanSignal. It serves as a comprehensive cheat sheet for ML teams.
A tweet emphasizing that a new hire who focuses on data labeling rather than immediately setting up GPU training is a good sign for a machine learning role.
Dan Shipper interviews Edwin Chen, CEO of Surge AI, about AI progress, the potential for AGI, and the implications for human motivation and uniqueness. They discuss AI's ability to solve novel math problems, the pitfalls of optimizing for engagement, and why AI still struggles with writing.
Merve (@mervenoyann) shares day two findings of a pipeline using multiple small VLMs as judges for road sign detection, achieving map@50=0.8028 with only 1.3k examples. The thread compares model rejection rates and discusses dataset shrinking, super-specific prompts, and plans to generalize the library.
A World Bank report and documentary uncover that AI systems depend on a hidden workforce of 150-430 million low-paid data workers, often refugees or crisis-stricken populations in the Global South, who perform exploitative labeling and annotation tasks under secrecy.
The article exposes how millions of low-paid workers in developing countries perform essential data labeling and content moderation for AI models under exploitative conditions, while tech companies obscure this human labor to maintain an illusion of full automation.