llama

Tag

Cards List
#llama

When Does Subspace Direction Matter for LoRA? Regime Analysis of the Magnitude Principle in Few-Shot Adaptation

arXiv cs.LG ↗ · 2d ago Cached

该论文研究 LoRA 适配器初始输入子空间方向的重要性为何依赖于数据 regime,提出基于激活 PCA 的 PivotLoRA 初始化方法,并在少样本 BERT/Llama 分类及 GSM8K、StrategyQA 任务上验证其优于原版 LoRA。

0 favorites 0 likes
#llama

Ex-Meta Researcher Torrented Pirated Books, Deleted It 'Due to Litigation'

Hacker News Top ↗ · 2026-10-31 Cached

前Meta研究员Stephen Roller在法庭证词中承认在职期间通过BitTorrent下载并分发了盗版Books3数据集,该数据集被用于训练Llama模型,尽管Meta此前否认通过BitTorrent获取该数据集。Meta回应称该下载可能是为个人用途,而原告计划要求法院进一步查明Meta获取和使用该数据集的详情。

0 favorites 0 likes
#llama

Next Token or Vector? Learning How Far to Decode

arXiv cs.LG ↗ · 2026-10-19 Cached

提出 CADENCE(Context-Adaptive Decoding)方法,通过高斯预测头与学习式路由自适应选择每次解码的跨度长度,在 Llama-3.1-8B-Instruct 上实现最高 1.3× 的生成吞吐提升。

0 favorites 0 likes
#llama

Reusing Calibration Gains across Model Representations

arXiv cs.LG ↗ · 2026-10-19 Cached

该论文研究如何将一个模型表示上学到的量化校准增益复用到同一预训练模型的其他表示(如浮点与INT3量化)上,无需接收端优化即可保留大部分文本损失改善,量化了校准更新的可迁移性与接收端专属训练的剩余收益。

0 favorites 0 likes
#llama

@rohanpaul_ai: Mark Zuckerberg talks about why the Llama run broke after Llama 3. says Llama 3 was a very good model and almost at the…

X AI KOLs Timeline ↗ · 2026-10-06 Cached

Mark Zuckerberg discusses why Meta's Llama development faltered after Llama 3, explaining that Llama 4 was staffed like an Instagram feed/ads team with thousands of engineers rather than a small frontier-science team, and reflects on how leaders respond when things go wrong.

0 favorites 0 likes
#llama

Attention Manifolds: Steering or Blocking Language Models by Editing Learned B-Spline Surfaces

arXiv cs.LG ↗ · 2026-10-03 Cached

The paper introduces attention manifolds — learned 2D B-spline surfaces that modulate value dimensions in transformer attention — showing 2–2.5 point perplexity improvements on LLaMA 3.2 with just 0.3% parameter overhead, plus mechanically editable surfaces enabling steering and attention walls for safety.

0 favorites 0 likes
#llama

CalDec v1 - Fully Open Decision Model for Personal Assistants

Reddit r/LocalLLaMA ↗ · 2026-10-02

CalDec v1 is a fully open-source, open-weights decision model for real-time, fully-local personal assistants, released with dataset and training recipes. Built by fine-tuning models like Laya and GLiNER, it showed promising results on decision tasks while remaining smaller than general-purpose alternatives like Jev.

0 favorites 0 likes
#llama

Opus 5.5 dropped another banger music vid

Reddit r/singularity ↗ · 2026-09-24 Cached

A spoken-word piece contrasts the view of AI as incremental technology with the perspective of exponential growth, critiquing figures like Gary Marcus and Yann LeCun while referencing models like LLaMA.

0 favorites 0 likes
#llama

What Changes When Fact-Verification Scores Improve? Evidence and Answer Accounting Across Trained Verifiers and LLMs

arXiv cs.CL ↗ · 2026-09-24 Cached

The paper quantifies how improvements in fact-verification scores are partitioned between answer accuracy and evidence quality, using trained DeBERTa checkpoints and LLMs across multiple benchmarks.

0 favorites 0 likes
#llama

Asymmetries in Spontaneous and Instructed Deception

arXiv cs.AI ↗ · 2026-09-02 Cached

This paper investigates the relationship between spontaneous and instructed deception in large language models, specifically Llama-3.1-70B-Instruct, finding asymmetries in detection and causation between the two settings.

0 favorites 0 likes
#llama

First time running local models

Reddit r/LocalLLaMA ↗ · 2026-08-31

A user shares their experience running the ik_llama model locally, praising its speed despite having only 12GB of VRAM.

0 favorites 0 likes
#llama

Muse Spark 1.2 Open Source before Llama 4 Behemoth!!?

Reddit r/LocalLLaMA ↗ · 2026-08-10

Muse Spark 1.2 is being open sourced, which is surprising given the focus on Llama 4 Behemoth. The author comments on the unexpected release order.

0 favorites 0 likes
#llama

Post-Training at the Edge of Detectability: A Game-Theoretic Approach to Fine-Tuning

arXiv cs.LG ↗ · 2026-07-30 Cached

This paper introduces a game-theoretic approach to fine-tuning language models that optimizes the trade-off between reward and deviating from a reference policy, providing a principled method for setting the KL regularization coefficient.

0 favorites 0 likes
#llama

@kuriharan: Estimated Quarter of Llama AI Sources Came From Books https://statista.com/chart/36465/estimated-data-source-distributi…

X AI KOLs Timeline ↗ · 2026-07-28

A Statista chart estimates that approximately a quarter of the training data for Meta's Llama AI model came from books, highlighting the composition of sources used in large language model development.

0 favorites 0 likes
#llama

Pointer-Augmented Autoregressive Generation of Patent Claims with Joint Topology and Content Decoding

arXiv cs.CL ↗ · 2026-07-28 Cached

This paper proposes SPG, a structure-aware patent generation method that jointly predicts claim topology and content during autoregressive decoding using a pointer head and a preference optimization stage, achieving significant improvements in parent link recovery and antecedent consistency on the HUPD-DCG benchmark.

0 favorites 0 likes
#llama

turns out the reason your tool calls randomly break on some models isn't random

Reddit r/AI_Agents ↗ · 2026-07-25

Testing 30 schema constraints across 16 models reveals each provider handles constraints differently, causing random tool call failures. The simple fix: move constraint text into property descriptions instead of relying on prompts.

0 favorites 0 likes
#llama

@ylecun: Soooo, releasing Linux was dumping? Apache, MySQL, PHP? HTTP, TCP/IP, OpenSSL, OpenSSH? Libjpeg, VLC? The open source s…

X AI KOLs Following ↗ · 2026-07-19 Cached

Yann LeCun defends open source by listing major projects like Linux, Apache, MySQL, and PyTorch, questioning the idea that releasing them was 'dumping'.

0 favorites 0 likes
#llama

A Shared Subcircuit Lets LLMs Count Down Across Tasks

arXiv cs.CL ↗ · 2026-07-15 Cached

This paper identifies a 'countdown subcircuit' in Llama-3.1-70B-Instruct that allows the model to track remaining tokens across various tasks, and demonstrates that this subcircuit is reused across different contexts and even models.

0 favorites 0 likes
#llama

@LottoLabs: So shortsighted for meta to stop releasing llama models

X AI KOLs Following ↗ · 2026-07-04

User criticizes Meta's decision to stop releasing Llama models, calling it shortsighted.

0 favorites 0 likes
#llama

Llama-b9856 Win Cuda 12.4 - Windows Defender claims it's a trojan

Reddit r/LocalLLaMA ↗ · 2026-07-01

Windows Defender flags a version of Llama-b9856 running on CUDA 12.4 as a trojan, raising security concerns.

0 favorites 0 likes
Next →
← Back to home

Submit Feedback