transfer-learning

Tag

Cards List
#transfer-learning

@rohanpaul_ai: New John Hopkins and Carnegie Mellon University Paper Shows that a small model can learn to improve an agent's harness …

X AI KOLs Following ↗ · 2026-10-05 Cached

A Johns Hopkins and Carnegie Mellon paper shows a 4B editor model can learn to rewrite an agent's harness code from failure reports, with edits transferring to unseen tasks and outperforming its 35B teacher on average edit scores.

0 favorites 0 likes
#transfer-learning

Mathematical Transfer in LLMs Follows Reasoning Approach More Than Topic

arXiv cs.AI ↗ · 2026-10-02 Cached

This paper shows that when selecting math training data for LLM fine-tuning, sharing a reasoning approach (e.g., invariant reasoning or double counting) yields significantly greater transfer to held-out targets than sharing a mathematical topic, with advantages of 8–16 percentage points across five base models in counterbalanced 2x2 designs.

0 favorites 0 likes
#transfer-learning

Beyond Prompt Count: How Data Shapes Transfer in On-Policy Distillation

Hugging Face Daily Papers ↗ · 2026-09-29 Cached

该论文研究提示数量、来源与选择如何影响在线策略蒸馏(OPD)的迁移效果,发现提示效用取决于师生模型对与目标任务,且定向选择策略(如语义多样性、难度、师生分歧等)并未一致优于均匀随机采样。

0 favorites 0 likes
#transfer-learning

Pretrain Once, Route Anywhere: Towards a Foundation Model for LLM Routing

Hugging Face Daily Papers ↗ · 2026-09-29 Cached

The paper introduces RouteFM, a foundation model for LLM routing that learns reusable routing capabilities via episodic pretraining across heterogeneous environments, allowing a frozen router to adapt to new domains, modalities, and candidate pools through behavioral context alone. RouteFM outperforms the strongest baseline by 2.23 quality points on MMR-Bench with only eight observations per candidate, supporting a 'pretrain once, route anywhere' paradigm.

0 favorites 0 likes
#transfer-learning

EVOKE: Eliciting World Knowledge in Agents for Transferable Decision-Making

Hugging Face Daily Papers ↗ · 2026-09-29 Cached

EVOKE is a post-training method that elicits world knowledge already present in pretrained LLM agents by contrasting alternative goals at fixed states, training policies to rank candidate actions by their consequences rather than contextual habits. It achieves state-of-the-art results across ALFWorld, WebShop, and search-based QA, and transfers well to unseen environments without needing world models or inference-time planning.

0 favorites 0 likes
#transfer-learning

OmniTaskonomy: When Does Visual Generation Improve Visual Understanding?

Hugging Face Daily Papers ↗ · 2026-09-29 Cached

The paper investigates how visual generation supervision can improve visual understanding capabilities, introducing OmniTaskonomy as a unified taxonomy to analyze task-dependent benefits and guide training curricula.

0 favorites 0 likes
#transfer-learning

In-Context Learning for Robots: Methods and Applications

Hugging Face Daily Papers ↗ · 2026-09-28 Cached

This paper reviews in-context learning methods for robots, categorizing them into four interface families and analyzing their application across manipulation and navigation tasks.

0 favorites 0 likes
#transfer-learning

From Text Decisions to Pixels: An Study of Jev-Style Visual Choice Model

arXiv cs.AI ↗ · 2026-09-25 Cached

PixelJev is introduced as a native-image decision interface using small open multimodal models to map images, instructions, and candidate sets to structured choices. The study demonstrates adaptation improves accuracy on benchmarks like Pets and highlights challenges in calibration and generalization.

0 favorites 0 likes
#transfer-learning

Learned Cross-Task Relationships in Multi-Task Models

arXiv cs.AI ↗ · 2026-09-25 Cached

This paper proposes a framework to learn cross-task relationships in multi-task models by approximating joint label distributions, improving performance in YouTube's recommendation systems through transfer learning.

0 favorites 0 likes
#transfer-learning

Transfer Learning with Conformalized Quantile Regression for Solar PV Forecasting Under Load-Shedding-Driven Data Scarcity

arXiv cs.LG ↗ · 2026-09-24 Cached

This paper combines transfer learning with conformalized quantile regression to improve solar PV forecasting accuracy and uncertainty quantification under data scarcity caused by load-shedding in Bangladesh, demonstrating significant performance gains over baseline methods.

0 favorites 0 likes
#transfer-learning

Signed Graph Pre-Training and Prompt Learning

arXiv cs.LG ↗ · 2026-09-23 Cached

The paper introduces TopoSIGN, a topology-guided graph pre-training and prompt learning framework for signed graphs, which combines structural encoding and persistent homology to improve transfer learning in tasks like link prediction and node classification.

0 favorites 0 likes
#transfer-learning

Graph Domain Adaptation Does Not End with Representation Learning

arXiv cs.LG ↗ · 2026-09-23 Cached

The paper proposes EviGDA, a framework that enhances graph domain adaptation by combining graph-aware and graph-free experts to improve prediction under structural shifts.

0 favorites 0 likes
#transfer-learning

Transferring the Intelligence of VLMs to Robotic Control

Hugging Face Daily Papers ↗ · 2026-09-19 Cached

This paper presents RoboDawn, a method to transfer Vision-Language Model intelligence to robotic control, achieving state-of-the-art results on benchmarks with zero-shot and one-shot learning and successful real-world applications.

0 favorites 0 likes
#transfer-learning

Past, Future, All at Once: Mitigating Stability-Plasticity Dilemma via Post-hoc JANUS Rectification

arXiv cs.LG ↗ · 2026-09-18 Cached

This paper introduces a post-hoc weight rectification framework called JANUS to mitigate catastrophic forgetting in fine-tuning foundation models, achieving parameter space orthogonality for preserving historical performance while adapting to new tasks.

0 favorites 0 likes
#transfer-learning

Beyond Embedding Transfer: Component Roles in Grokking Transfer and Stability

arXiv cs.LG ↗ · 2026-09-17 Cached

This paper investigates component roles in warm-start transfer for grokking in neural networks, showing that transferring internal weights improves early performance but risks instability, and proposes methods to stabilize the process.

0 favorites 0 likes
#transfer-learning

Procedural Pretraining for Molecular Property Prediction

arXiv cs.LG ↗ · 2026-09-17 Cached

The paper introduces a three-stage training pipeline using procedural pretraining to improve molecular property prediction, showing enhanced performance under data scarcity by learning inductive biases from abstract generated data.

0 favorites 0 likes
#transfer-learning

AI for Games in the Foundation Model Era

arXiv cs.AI ↗ · 2026-09-16 Cached

This survey paper organizes AI applications in games into six roles based on foundation models, discussing transferability and evaluation challenges across the game lifecycle.

0 favorites 0 likes
#transfer-learning

Schema-Adaptive Action-Conditioned JEPA for Cross-Machine CNC Transfer under Partial Sensor Overlap

arXiv cs.LG ↗ · 2026-09-16 Cached

The paper presents SAAC-JEPA, a schema-adaptive action-conditioned JEPA model for transferring predictive representations across CNC machines with partial sensor overlap, demonstrating that cross-machine adaptation requires distinct evaluation beyond source-domain accuracy.

0 favorites 0 likes
#transfer-learning

Portable Semantics, Private Dialects: Reuse and Negative Transfer in Latent Communication Between Language-Model Cells

arXiv cs.AI ↗ · 2026-09-12 Cached

This paper investigates portable semantics and negative transfer in latent communication between language-model cells, showing that independently trained societies share semantic interfaces but not raw language, and that inherited interfaces can cause severe negative transfer.

0 favorites 0 likes
#transfer-learning

The information geometry of large language models is shared, learned, and controllable

arXiv cs.LG ↗ · 2026-09-11 Cached

This paper uses Fisher–Rao geometry to show that large language models share behavioral structures that are learned and controllable, enabling transfer learning and minimal-disturbance interventions.

0 favorites 0 likes
← Previous
Next →
← Back to home

Submit Feedback