qlora

Tag

Cards List
#qlora

AK_QMUL at ArGuard Shared Tasks: A Single Fine-Tuned JAIS for Arabic Harmful-Prompt Detection

arXiv cs.CL ↗ · 2026-10-28 Cached

AK_QMUL 的论文介绍其在 ArGuard-2026 共享任务中的提交:基于 JAIS-6.7B 的 4-bit QLoRA 微调模型,用于阿拉伯语有害提示检测(安全/不安全二分类与七类有害领域分类),两项任务均获第一名,macro-F1 分别为 0.984 和 0.790。

0 favorites 0 likes
#qlora

alkhder at AlexandriaX-2026: Context-Aware English-to-Dialectal Arabic Dialogue Translation with QLoRA-Fine-Tuned NileChat-3B

arXiv cs.CL ↗ · 2026-10-19 Cached

Team Alkhder's AlexandriaX-2026 shared-task submission QLoRA-fine-tunes NileChat-3B-Base for context-aware English-to-13-dialectal-Arabic dialogue translation, achieving spBLEU 20.36 and chrF++ 36.64 while ranking sixth in both tracks.

0 favorites 0 likes
#qlora

MeddeX: A Retrieval-Augmented LLaMA-3 System with Gemini Vision for Evidence-Backed Medical Report Analysis

arXiv cs.CL ↗ · 2026-10-16 Cached

该论文提出 MeddeX 系统,结合 QLoRA 微调的 LLaMA-3 (8B)、报告级检索增强生成 (RAG) 以及 Gemini Vision 多模态层,实现对医疗报告的证据支撑式摘要与分析,并在 ROUGE、BLEU 和 BERTScore 上相对基线模型取得一致提升。

0 favorites 0 likes
#qlora

U4RASD at KnowledgeGraphEval-2026: Ontology-Constrained Encoder and LLM Systems for Arabic Relation Extraction

arXiv cs.CL ↗ · 2026-10-12 Cached

该论文介绍了团队参加 KnowledgeGraphEval 2026 子任务2(阿拉伯语关系抽取)的系统:结合基于编码器的方法与微调 Yehia、Qwen3.5 的 LLM 系统,最佳集成系统在子任务2中以 94.06 的 micro-F1 获得第一名,凸显了约束预测与多种建模方法互补的重要性。

0 favorites 0 likes
#qlora

Shaer: Controlled Arabic Poetry Generation with Meter Subform and Semantic Conditioning

arXiv cs.CL ↗ · 2026-10-08 Cached

Shaer: a controllable Classical Arabic poetry generation framework that jointly conditions on natural-language descriptions, meter subforms, and target hemistich counts, built by QLoRA fine-tuning Yehia-7B on a 116,032-poem enriched corpus, achieving 95.17% base-meter accuracy and strong length/subform control.

0 favorites 0 likes
#qlora

When Does AI Supervision Help? A Role-Aware Study of Network Fraud Decision Management with Blockchain Auditability

arXiv cs.AI ↗ · 2026-10-08

This arXiv paper introduces a role-aware Decider-Supervisor framework combining centralized ML, a FedAvg-trained federated meta-model, and Base/QLoRA LLM variants with blockchain auditability, finding that AI supervision only reduces fraud-decision errors under specific roles, calibration, and traffic conditions rather than by default.

0 favorites 0 likes
#qlora

Watch me post-train AliceAI-Foundation-80B-A3B from base to instruct at home, live, on my V100s!

Reddit r/LocalLLaMA ↗ · 2026-09-28

A developer live streams the post-training process of the AliceAI-Foundation-80B-A3B model from base to instruct using distillation and QLoRA on personal V100 GPUs, detailing dataset creation and training steps in real-time.

0 favorites 0 likes
#qlora

@yibie: https://x.com/yibie/status/2101502455544451502

X AI KOLs Timeline ↗ · 2026-09-20 Cached

This article provides a complete guide on fine-tuning small models with your own data, covering data collection, cleaning, training, evaluation, and deployment, with emphasis on data rights and evaluation discipline.

0 favorites 0 likes
#qlora

Learning New Facts with QLoRA: An Acquisition-Retention Frontier

arXiv cs.CL ↗ · 2026-08-27 Cached

This paper explores the trade-off between factual knowledge acquisition and capability retention in language models when using QLoRA, showing that higher-rank QLoRA improves fact learning but may degrade out-of-domain performance.

0 favorites 0 likes
#qlora

How to Fine-Tune an LLM: An End-to-End Guide

Reddit r/LocalLLaMA ↗ · 2026-08-26 Cached

This article provides a guide on fine-tuning LLMs, highlighting its benefits over RAG and system prompts with a case study where fine-tuning a Mistral 7B model improved accuracy from 35% to 98% for a medical reporting task.

0 favorites 0 likes
#qlora

PSK at WMT 2026 MIST: Task-Specialized QLoRA Adapters for Multilingual Summarization and Question Answering

arXiv cs.CL ↗ · 2026-08-24 Cached

The paper describes a submission to the WMT 2026 MIST shared task, using the Tiny Aya Global model with task-specialized QLoRA adapters for multilingual summarization and question answering.

0 favorites 0 likes
#qlora

I fine tuned Gemma 4 12B for a 2.7x improvement on tool calling because I can't fit anything else comfortably into my 16 GBs of Vram

Reddit r/LocalLLaMA ↗ · 2026-08-23 Cached

A fine-tuned version of Gemma 4 12B that improves tool-calling reliability by 2.7x, optimized for consumer GPUs with 16GB VRAM using QLoRA training.

0 favorites 0 likes
#qlora

@deedydas: Met a kid y'day who has 50+ agents running with a harness tuned for cyber security and a search index of CVEs with a QL…

X AI KOLs Following ↗ · 2026-08-21 Cached

The article describes an individual who runs over 50 AI agents tuned for cybersecurity with a search index of CVEs, using a QLoRA-tuned GLM 5.2 model to continuously test production websites for vulnerabilities and earn money through bug bounties.

0 favorites 0 likes
#qlora

Energy- and Memory-Efficient PEFT Methods for Personalized On-Device SLMs on Consumer GPUs

arXiv cs.CL ↗ · 2026-08-06 Cached

The paper compares five parameter-efficient fine-tuning methods on four small language models for on-device personalization, finding LoRA+ best for energy efficiency and QLoRA best for memory-limited deployment.

0 favorites 0 likes
#qlora

Show HN: Fine-tune an 8B model on a 4 GB laptop GPU

Hacker News Top ↗ · 2026-08-04 Cached

Soup is an open-source CLI that simplifies LLM fine-tuning and post-training with a single command, enabling QLoRA-based training on consumer GPUs with as little as 4 GB VRAM via layer streaming. The latest version adds preference losses like DPO, ORPO, SimPO, and KTO without doubling memory requirements.

0 favorites 0 likes
#qlora

Encoding Invisible Causation for Bridge Diagnostic Agents: Triple-Guided Retrieval-Augmented Fine-Tuning with QLoRA

arXiv cs.LG ↗ · 2026-07-27 Cached

This paper proposes a Damage Cause Encoder for bridge diagnostic agents that uses knowledge triple extraction from manuals and retrieval-augmented fine-tuning with QLoRA, achieving high accuracy with lower memory usage.

0 favorites 0 likes
#qlora

The qlora 2e-4 default is wrong under 10k samples and nobody talks about it [D]

Reddit r/MachineLearning ↗ · 2026-07-16

The author argues that the commonly recommended learning rate of 2e-4 for QLoRA fine-tuning is too high for datasets under 10k samples, leading to overfitting and poor evaluation, and suggests using a lower learning rate like 1e-4.

0 favorites 0 likes
#qlora

@h100envy: Ex-JPMorgan engineer who wrote the LLM Course explained everything about fine-tuning and merging in 18 minutes - better…

X AI KOLs Timeline ↗ · 2026-07-15 Cached

An ex-JPMorgan engineer behind the LLM Course offers an 18-minute guide on fine-tuning and merging models using LoRA, QLoRA, DPO, KTO, and mergekit, claiming it outperforms costly bootcamps.

0 favorites 0 likes
#qlora

Fine-tuned Gemma-4-31B specifically for Copywriting & Creative Writing Tasks (Scored +290 Elo over base using EqBench3)

Reddit r/LocalLLaMA ↗ · 2026-07-02

Akwin123 fine-tuned Gemma-4-31B-it specifically for copywriting and creative writing tasks, achieving a +290 Elo improvement over the base model on a custom benchmark using QLoRA. The model is open-source and available on Hugging Face.

0 favorites 0 likes
#qlora

@jbhuang0604: LoRA, low-rank adaptation, is arguably the most popular parameter-efficient fine-tuning method for LLMs. But how does i…

X AI KOLs Timeline ↗ · 2026-06-25 Cached

LoRA (low-rank adaptation) is the most popular parameter-efficient fine-tuning method for LLMs. This video introduces how LoRA and its variants (LoRA+, QLoRA, VeRA, DoRA) work.

0 favorites 0 likes
Next →
← Back to home

Submit Feedback