lora

Tag

Cards List
#lora

Dynamics of Hidden Learning Structure

arXiv cs.LG ↗ · 2026-10-22 Cached

该论文提出 Fiber Regulation Theory (FRT) 与 Fiber Acquisition Theory (FAT) 两个理论框架,刻画受保护的功能修复与可训练结构的形成/续期动力学,并在 Qwen2.5-32B 上通过受保护头修复与固定容量 LoRA 续期验证联合策略优于单独策略。

0 favorites 0 likes
#lora

Fast LoRA in llama.cpp

Reddit r/LocalLLaMA ↗ · 2026-10-21

A developer shares custom general and fused LoRA kernels for llama.cpp that restore prompt-processing throughput on Strix Halo from ~300 t/s back up to ~1400 t/s when running LoRA adapters, and invites others to help upstream the changes.

0 favorites 0 likes
#lora

Evaluating Tibetan Speech Recognition Across Dialects and Adaptation Regimes: A Multi-Granularity Analysis

arXiv cs.CL ↗ · 2026-10-21 Cached

该论文提出一个多粒度评估框架,结合字符错误率、音节错误率和分词错误率,评估藏语语音识别在多方言与不同适配策略下的表现,发现低字符错误率并不总带来更优的高层级指标,且 LoRA 适配在测试范围内仍逊于全量微调。

0 favorites 0 likes
#lora

Mixture of Phonetic Experts Based Low-Rank Adaptation of Conformer Models for Accented English Speech Recognition

arXiv cs.CL ↗ · 2026-10-21 Cached

该论文提出 MoPE-LoRA,一种基于音素类别(发音方式)而非口音身份组织低秩专家的参数高效适配框架,用于带口音的英语语音识别;在 L2-ARCTIC 上零样本口音评估中相对单 LoRA 提升 12.3%。

0 favorites 0 likes
#lora

LSA-PAST: Layer-Specific Adaptation and Prototype Transport for Compositional Incremental Learning

arXiv cs.AI ↗ · 2026-10-21 Cached

论文提出 LSA-PAST,一种面向组合式增量学习(composition-IL)的参数高效方法,通过在冻结 ViT 中注入深度特化的 LoRA 适配器并用无复习的仿射变换将旧原型映射到新适配器空间,实现了精度-遗忘权衡的 state-of-the-art 表现。

0 favorites 0 likes
#lora

SolarRenderer: Few-Step Generative Reference Rendering

Hugging Face Daily Papers ↗ · 2026-10-20 Cached

SolarRenderer 将任意引擎的无纹理结构通道结合参考首帧,生成风格化完整视频,基于 MiniMax-H3 构建,通过控制 LoRA 与少步蒸馏 LoRA 实现实时逐帧结构一致的渲染,无需按游戏训练。

0 favorites 0 likes
#lora

Herbert plays snake (open Jev)

Reddit r/LocalLLaMA ↗ · 2026-10-19

用户分享了使用 Jev(Qwen 3.8 27B LoRA 决策模型)驱动的贪吃蛇游戏,模型在每步操作时根据棋盘状态文本描述进行决策,延迟约 600ms,运行于 llama.cpp 环境中。

0 favorites 0 likes
#lora

Show HN: Qwen3-4B with the AI writing tics trained out

Hacker News Top ↗ · 2026-10-19 Cached

A small open model, qwen3-4b-deslop, is a Qwen3-4B-Instruct fine-tune trained on a MacBook Air that removes common AI writing tics (em dashes, 'not X, but Y', lists of three), cutting the slop score from 121 to 12.5 per 1000 words while keeping factual accuracy, and it runs locally via Ollama.

0 favorites 0 likes
#lora

@_avichawla: I have been fine-tuning LLMs for over 3 years now. Here are 5 LLM fine-tuning techniques, explained with visuals: Tradi…

X AI KOLs Timeline ↗ · 2026-10-19 Cached

An educational post breaking down 5 parameter-efficient fine-tuning (PEFT) techniques for LLMs — LoRA, LoRA-FA, VeRA, Delta-LoRA, and LoRA+ — with visual explanations of how each adapts low-rank matrices to reduce memory and training costs.

0 favorites 0 likes
#lora

@javawock7618: Looks like Turbo LoRA for Moss-Image has been released

X AI KOLs Timeline ↗ · 2026-10-19 Cached

MOSS-Image Turbo LoRA (4-step) v2.0 has been released on Hugging Face, now Euler-native so it runs on the stock flow-matching sampler in any standard LoRA loader with no CFG or custom pipeline files, delivering fast high-fidelity bilingual text rendering.

0 favorites 0 likes
#lora

lodestones/Kromoss

Hugging Face Models Trending ↗ · 2026-10-19 Cached

Kromoss is a full fine-tune of MOSS-Image-Base at 1024px, shipping with two 8-step turbo LoRAs (DMD and DMD2-distilled) and drop-in support for diffusers and ComfyUI, including an int8 quantized variant.

0 favorites 0 likes
#lora

Scaling Parameter-Efficient Fine-Tuning for Brain Encoding

Hugging Face Daily Papers ↗ · 2026-10-19 Cached

该论文提出使用参数高效微调(PEFT/低秩适配器)来适配超大多模态骨干网络进行脑编码,Brain LoRA 在 Algonauts 2025 挑战赛中取得最佳公开成绩,并通过 multi-LoRA kernel 支持 200+ 模型集成。

0 favorites 0 likes
#lora

[P] asmsense: 228k stripped x86-64 functions with source-aware labels, and a map of the data we still lack. [P]

Reddit r/MachineLearning ↗ · 2026-10-18

asmsense is a dataset of 228k stripped x86-64 functions with source-aware labels plus a Qwen3-8B+LoRA model for naming and describing functions in stripped binaries, along with a detailed roadmap of missing data such as ARM64/RISC-V support and GCC/ELF builds.

0 favorites 0 likes
#lora

Uncensored models via LORA

Reddit r/LocalLLaMA ↗ · 2026-10-17

A discussion about using LoRA adapters as a cheaper, more flexible alternative to tools like Heretic for removing refusals/censorship from LLMs, referencing the weightless GitHub project and similar LoRAs for image model text encoders.

0 favorites 0 likes
#lora

d3-edge (0.6B) fine-tuned outperformed d3 (27B) decision model

Reddit r/LocalLLaMA ↗ · 2026-10-16

A 0.6B parameter d3-edge model, fine-tuned with SFT + LoRA on a few thousand examples, outperformed the 27B d3 decision model on typed decisions and nearly matched it on Banking77, highlighting the value of fine-tuning small specialized models over large general-purpose ones.

0 favorites 0 likes
#lora

lodestones/MOSS-Image-SFT-8-steps-dmd

Hugging Face Models Trending ↗ · 2026-10-16 Cached

Hugging Face 上发布 lodestones/MOSS-Image-SFT-8-steps-dmd,一个将 MOSS-Image-SFT(50 步、CFG 3)蒸馏为 8 步、无 CFG 的工作进展检查点,采用 data-space DMD 方法,可作为 LoRA 用于 ComfyUI。

0 favorites 0 likes
#lora

Does Personalization Break Trust? Open-Set Rejection Calibration Under Few-Shot On-Device Intent Adaptation

arXiv cs.CL ↗ · 2026-10-16 Cached

This paper shows that naive few-shot LoRA personalization on-device degrades out-of-scope (OOS) rejection AUROC across five intent-classification benchmarks while preserving in-scope accuracy, and proposes a training-free fix using Mahalanobis-distance-based rejection scoring that recovers most of the lost quality on 3 of 5 datasets.

0 favorites 0 likes
#lora

@linoy_tsaban: New 3-step(!) LoRA for H3 from Alibaba TaoLive AIGC continuously at awe by the amount of H3 LoRAs coming out

X AI KOLs Timeline ↗ · 2026-10-15 Cached

阿里巴巴 TaoLive AIGC 团队发布了 TaoMate-H3-FL2VA,据称是首个实时流式首尾帧控制的音频-视频生成(FL2VA)模型,基于 MiniMax H3 的三步 LoRA,支持低延迟分块生成与 480p/768p/1080p 分辨率。

0 favorites 0 likes
#lora

AcrossVAM2.0: Conflict-Aware Point Supervision for Parameter-Efficient Video Diffusion Adaptation

arXiv cs.AI ↗ · 2026-10-15 Cached

AcrossVAM2.0 提出一种冲突感知的点对应监督方法,用于参数高效的视频扩散模型适配,通过置信度加权跟踪头、零初始化残差反馈和非对称 PCGrad,在保持预训练外观先验的同时提升对应一致性,但并不均匀改善视频质量。

0 favorites 0 likes
#lora

Iterate on an LLM, Serve on an SLM

arXiv cs.AI ↗ · 2026-10-15 Cached

提出「在前沿LLM上迭代开发行为,再蒸馏到小模型(SLM)上线」的两阶段方法:用LoRA微调的Qwen3-8B在家庭护理排班智能体的生产决策上达到0.913一致率,优于教师模型GPT-5.4-nano自身重跑时72.7%的自我一致性,且延迟降低约2.5倍、成本大幅下降。论文已被NeurIPS 2026第二届企业任务智能体基准与应用研讨会(AABA4ET)接收。

0 favorites 0 likes
← Previous
Next →
← Back to home

Submit Feedback