Tag
The paper shows that Matryoshka Representation Learning embedding prefixes align with coarse-to-fine gold taxonomy granularity, and introduces PEEL, a minimal probe that decodes taxonomic DAGs from frozen embeddings with high fidelity across domains.
A paper introducing MIOE, a causal-ablation benchmark that uses interchange interventions to evaluate whether LLMs (Qwen3-8B/4B) mechanistically solve ontology tasks like entity typing and subsumption prediction, finding distributed subspace methods work best but don't yet fully disentangle ontological knowledge from auxiliary class information.
This paper studies whether ontology-derived checks reliably validate LLM agents answering questions over knowledge graphs, comparing curated, LLM-generated, and data-derived ontologies and finding that curated ontologies can flag correct answers more often than alternatives, with flags only marginally more precise than random.
有人开源了被称为"AI知识图谱版Terraform"的工具 Open Ontologies,可让AI推理变得可验证,支持增量修改预览、事实校验与RAG声明验证,并通过MCP集成Claude Code、Cursor、Windsurf等工具。
该论文提出 Recursive Knowledge Improvement (RKI),将知识改进建模为序列化、状态感知的干预过程,通过区分知识状态别名问题来指导干预选择,在 HotpotEval 和 SafeInternalEval 上平均提升 18.41 分。
OA-RAG is an agentic framework that combines formal ontology-based reasoning with LLM reasoning to improve faithfulness in retrieval-augmented generation, reporting grounding levels (entailed, supported, related, unrelated) and achieving top performance on medical QA benchmarks derived from large-scale ontologies.
IBM researchers formalize LLM consistency as scoped semantic invariance over knowledge-graph-defined semantic domains, showing inconsistencies cluster in stable hotspot subgraphs and that selective, layered KG grounding improves cross-model agreement and reliability.
本文综述了数据、信息、链接数据及知识图谱的质量评估研究,提出包含24个质量维度和相应度量指标的知识图谱质量评估框架,以评估LLM时代知识图谱的可信度与适用性。
NVIDIA expands its open source Agent Toolkit with the new Agent Knowledge Foundation, adding CUDA-X libraries, Auto-Ontology, Nemotron Retriever and the Kumo family of structured-data models, alongside OpenShell runtime and NemoClaw blueprints, to help enterprises ground AI agents in proprietary company data with governance controls. Early adopters include Palantir, Databricks, Snowflake and Amazon OpenSearch Service.
本文提出一个可解释的、以表头为中心的框架,用于仅元数据场景下的列类型标注与数据质量评估,将表头映射为39种可解释类型并触发验证规则,生成单元格级数据质量问题实例及数据源级质量指标HeadersIQ,已在多个基准约12万列上评估。
A survey of 300 tech and AI executives finds that only about 34% of agentic AI projects reach production, with data fragmentation and missing organizational context as key bottlenecks — pointing to knowledge layers, RAG, and knowledge graphs as the priority investments to connect agents to enterprise data.
The paper proposes a pipeline that automatically generates ontology-grounded, reasoner-verified multiple-choice benchmarks for evaluating LLM logical reasoning in scientific AI, validated on three ontologies (Pizza, PMDco, DOID) across six LLMs.
Build2SPARQL introduces a large-scale KG-grounded benchmark (6,136 validated SPARQL queries, 30,680 questions) for text-to-SPARQL querying over building knowledge graphs, where SPARQL queries are generated and validated by graph-traversal code and LLMs only produce natural-language questions. Retrieval-augmented evaluation of three open-weight models lifts exact-match accuracy from 0.2–20% zero-shot to 56–65% with three-shot retrieved context.
EviGraph is a proof-carrying selective recommendation system for temporal public-service knowledge graphs, using an LLM agent to link decision-critical evidence and a deterministic checker to validate recommendations. Evaluated on a bilingual Hong Kong public-service benchmark, it shows that distinguishing critical from non-critical evidence reduces unnecessary abstention, while extra verification can withdraw supported recommendations without improving decision quality.
GraphCert proposes bootstrapping agentic graph reasoning with certified evidence rubrics during post-training, using a Bootstrapped Graph Quizzer and execution-certified QA pairs to reward evidence alignment in GRPO, outperforming larger LLM agents on five GRBENCH graph reasoning domains.
SeKondBrain AI Labs introduces the Concept Lifecycle Model and Concept-Grounded Attention, evaluating graph-injected attention, temporal versioning, and epistemic status on QA benchmarks. The results support explicit temporal validity and epistemic status while showing that several graph-attention mechanisms fail controlled comparisons with disabled-mechanism baselines.
The paper introduces VisKG, a reinforcement learning framework that trains vision-language models to translate images into question-specific knowledge graph representations, improving VQA reasoning efficiency while reducing token usage. A proposed GDPO objective outperforms GRPO-trained counterparts by an average of 2% accuracy across science, math, and general visual reasoning benchmarks.
GeoOutageBench introduces a benchmark for ambiguity-aware, ontology-grounded geospatiotemporal knowledge graph question answering (KGQA) that integrates multimodal data (outage records, remote sensing, weather, storm and power events) to support power outage and resilience analysis, presented at SIGSPATIAL '26.
This paper explores using instruction-tuned LLMs to analyze collaborative student sensemaking in science learning, finding that reasoning-enabled prompting and knowledge-state diagnostics improve alignment with expert annotations.
This paper proposes a knowledge graph-based evaluation framework for assessing the contextual understanding of large language models in question answering, introducing a new similarity measure called S3KG that achieves superior performance over existing baselines.