data-quality

Tag

Cards List
#data-quality

@allen_datumwell: https://x.com/allen_datumwell/status/2123813175644782633

X AI KOLs Timeline ↗ · 5h ago Cached

An in-depth, practice-oriented article on "data taste" in the large model field, covering the complete loop of data collection, filtering, usage, quality, and evaluation. It systematically reviews sources such as crawlers, open-source datasets, and synthetic data, along with the key findings and training recipes from research including Data Selection, Chinchilla Scaling Law, ATLAS, DeepSeek-R1, and Nemotron.

0 favorites 0 likes
#data-quality

We read 900 messages sent to a sales assistant we built. The useful part was what it couldn’t answer.

Reddit r/AI_Agents ↗ · 8h ago

BotsCrew analyzed 900 messages sent to an internal AI assistant built for car dealership sales reps and found the unanswered questions revealed missing competitor data — a data problem that no API integration or prompt engineering could fix.

0 favorites 0 likes
#data-quality

Confidence-Based Materials Data Quality Assessment via Domain Knowledge and Graph-Structured Learning

arXiv cs.LG ↗ · yesterday Cached

This paper proposes a confidence-based materials data quality assessment framework combining domain knowledge rules with graph-structured learning, including a nine-dimensional quality prior, sample-feature bipartite graph propagation, weakly supervised graph attention, and a Memory-GAT module for historical reference scoring. Experiments show improved AUC-ROC and R² on ODDS benchmarks and materials datasets like mp_20 and MACE subsets.

0 favorites 0 likes
#data-quality

Raising the quality of insights in agentic analytics

MIT Technology Review ↗ · 2026-11-02 Cached

A MIT Technology Review report sponsored by Snowflake finds that only 48% of analytics-agent insights lead to business improvements, with insufficient context and insight overload cited as key blockers, while 'insight leaders' exceed 70% by strengthening governance and adding semantic layers.

0 favorites 0 likes
#data-quality

@AhmedSQRD: Synthetic rewrites are now standard to improve data quality and when data is limited. But how much compute should you s…

X AI KOLs Following ↗ · 2026-10-30 Cached

A thread presenting research that fits scaling laws to determine how much compute to invest in synthetic rewrites for improving data quality, and whether a model trained on rewrites can surpass the rewriting model itself.

0 favorites 0 likes
#data-quality

Zombie stats: Where the numbers AI quotes come from

Hacker News Top ↗ · 2026-10-29 Cached

Trakkr Research tested 1,285 statistics cited by ChatGPT, Perplexity, Gemini, Claude, and Google AI Overviews, finding only 40% traced back to a study saying the same thing, while many 'zombie stats' circulate with no research behind them.

0 favorites 0 likes
#data-quality

Data Optimization for LLMs: A Survey

arXiv cs.AI ↗ · 2026-10-27 Cached

一篇关于大语言模型数据优化的综述论文,系统梳理了数据感知维度(质量、难度、多样性、冗余性)以及数据选择、增强、重加权等优化技术,并探讨了该领域面临的挑战与未来方向。

0 favorites 0 likes
#data-quality

Knowledge Graphs Quality Assessment in the Era of LLMs: A Conceptual Framework

arXiv cs.CL ↗ · 2026-10-26

本文综述了数据、信息、链接数据及知识图谱的质量评估研究,提出包含24个质量维度和相应度量指标的知识图谱质量评估框架,以评估LLM时代知识图谱的可信度与适用性。

0 favorites 0 likes
#data-quality

Our research agent was great on 10 sites and fell apart at 200

Reddit r/AI_Agents ↗ · 2026-10-20

A practitioner explains how their AI research agent went from near-zero errors on 10 curated sites to over 30% failure on 200 real domains, concluding the root cause was the pipeline's inability to distinguish an empty result from a broken fetch. Adding a fetch-level confidence score surfaced more bad rows than any prior prompt tuning.

0 favorites 0 likes
#data-quality

@shikibmehri: imo there's a missing parameter in the scaling laws: H -- the amount of human effort/time leveraged to produce learning…

X AI KOLs Following ↗ · 2026-10-15 Cached

The author argues that scaling laws are missing a parameter H — human effort/time invested in producing learning signal — and that most recent AI gains (ChatGPT's RLHF, coding/math verifiable tasks, data vendor value) stem from scaling H rather than model size or data alone.

0 favorites 0 likes
#data-quality

Brussle

Product Hunt ↗ · 2026-10-15 Cached

Brussle 是一款在 Product Hunt 上推出的产品,用于校准 Jev 等 AI 模型在你自己的数据上的决策输出,当数据记录或模型发生变化时自动重新运行和拟合,并且仅在超越模型于留出结果上的表现时才应用修正。

0 favorites 0 likes
#data-quality

Host-Aware Web Crawling for LLM Pretraining Data

arXiv cs.CL ↗ · 2026-10-12 Cached

该论文研究了 LLM 预训练数据采集中的爬虫预算分配问题,发现文档质量在主机层面存在显著聚集性,通过先采样少量页面再按质量深入爬取,可比统一深度或基于中心度的分配多收集数倍高质量页面。

0 favorites 0 likes
#data-quality

The agent is rarely the hard part. Here's the readiness check I run before scoping any company-wide AI agent build

Reddit r/AI_Agents ↗ · 2026-10-11

A practitioner shares a five-area readiness check (infrastructure, data, cybersecurity, governance, implementation risk) to run before scoping company-wide AI agent builds, arguing the environment—not the agent—is what sinks projects.

0 favorites 0 likes
#data-quality

@latkins: Congratulations to the awesome team @datologyai! A lot of blood, sweat, tears and ingenuity went into making this possi…

X AI KOLs Timeline ↗ · 2026-10-09 Cached

DatologyAI launched the Datology Curation Studio, a customizable frontier data curation platform for teams training their own models, positioning data quality as the ultimate compute multiplier.

0 favorites 0 likes
#data-quality

An Explainable Header-Centric Framework for Large-Scale Semantic Table Interpretation and Data Quality Assessment

arXiv cs.AI ↗ · 2026-10-09 Cached

本文提出一个可解释的、以表头为中心的框架,用于仅元数据场景下的列类型标注与数据质量评估,将表头映射为39种可解释类型并触发验证规则,生成单元格级数据质量问题实例及数据源级质量指标HeadersIQ,已在多个基准约12万列上评估。

0 favorites 0 likes
#data-quality

CuratorMAS: Automating Dataset Curation via Multi-Agent Orchestration

arXiv cs.AI ↗ · 2026-10-08 Cached

CuratorMAS proposes a multi-agent orchestration framework that automates dataset curation through five programmable stages—exploration, knowledge retrieval, evaluation, filtering, and skill evolution—reducing noise rates by up to 36.03 pp and improving downstream F1 scores by up to 8.88 pp.

0 favorites 0 likes
#data-quality

The hardest part of building AI agents has nothing to do with AI

Reddit r/AI_Agents ↗ · 2026-10-02

A practitioner argues that the real difficulty of building AI agents is not the model but data quality, failure-path design, process discovery, scope discipline, and handoff — sharing concrete checks and rules for deciding what to automate.

0 favorites 0 likes
#data-quality

Jevotron: Multiple Jev integrations from the command line

Hacker News Top ↗ · 2026-10-01 Cached

Jevotron is a command-line tool that provides multiple Jev integrations for one-shot anomaly detection on files like CSV, YAML, JSON, and OBO, caching assessments in SQLite and exporting review reports with visible probabilities and evidence.

0 favorites 0 likes
#data-quality

How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text

Hugging Face Daily Papers ↗ · 2026-09-30 Cached

This paper studies how unlabeled, AI-generated web text affects language model pretraining by training 800 models and fitting new scaling laws. It finds AI text helps data-starved models initially but quickly turns harmful for human-heavy budgets, proposes a scaling law with separate benefit and harm terms that outperforms existing laws, and releases the WildAI 83B-token corpus and all models.

0 favorites 0 likes
#data-quality

@bojie_li: Just finished watching Teacher He Jiyan from Zhongguancun College lead 7 PhD students to train a 7B model from scratch …

X AI KOLs Timeline ↗ · 2026-09-25 Cached

Teacher He Jiyan and 7 PhD students from Zhongguancun College trained a 7B model from scratch in 3 months, achieving state-of-the-art performance in the 7B model category, with insights on efficient training and data quality.

0 favorites 0 likes
Next →
← Back to home

Submit Feedback