Tag
AK_QMUL 的论文介绍其在 ArGuard-2026 共享任务中的提交:基于 JAIS-6.7B 的 4-bit QLoRA 微调模型,用于阿拉伯语有害提示检测(安全/不安全二分类与七类有害领域分类),两项任务均获第一名,macro-F1 分别为 0.984 和 0.790。
Team Alkhder's AlexandriaX-2026 shared-task submission QLoRA-fine-tunes NileChat-3B-Base for context-aware English-to-13-dialectal-Arabic dialogue translation, achieving spBLEU 20.36 and chrF++ 36.64 while ranking sixth in both tracks.
该论文提出 MeddeX 系统,结合 QLoRA 微调的 LLaMA-3 (8B)、报告级检索增强生成 (RAG) 以及 Gemini Vision 多模态层,实现对医疗报告的证据支撑式摘要与分析,并在 ROUGE、BLEU 和 BERTScore 上相对基线模型取得一致提升。
该论文介绍了团队参加 KnowledgeGraphEval 2026 子任务2(阿拉伯语关系抽取)的系统:结合基于编码器的方法与微调 Yehia、Qwen3.5 的 LLM 系统,最佳集成系统在子任务2中以 94.06 的 micro-F1 获得第一名,凸显了约束预测与多种建模方法互补的重要性。
Shaer: a controllable Classical Arabic poetry generation framework that jointly conditions on natural-language descriptions, meter subforms, and target hemistich counts, built by QLoRA fine-tuning Yehia-7B on a 116,032-poem enriched corpus, achieving 95.17% base-meter accuracy and strong length/subform control.
This arXiv paper introduces a role-aware Decider-Supervisor framework combining centralized ML, a FedAvg-trained federated meta-model, and Base/QLoRA LLM variants with blockchain auditability, finding that AI supervision only reduces fraud-decision errors under specific roles, calibration, and traffic conditions rather than by default.
A developer live streams the post-training process of the AliceAI-Foundation-80B-A3B model from base to instruct using distillation and QLoRA on personal V100 GPUs, detailing dataset creation and training steps in real-time.
This article provides a complete guide on fine-tuning small models with your own data, covering data collection, cleaning, training, evaluation, and deployment, with emphasis on data rights and evaluation discipline.
This paper explores the trade-off between factual knowledge acquisition and capability retention in language models when using QLoRA, showing that higher-rank QLoRA improves fact learning but may degrade out-of-domain performance.
This article provides a guide on fine-tuning LLMs, highlighting its benefits over RAG and system prompts with a case study where fine-tuning a Mistral 7B model improved accuracy from 35% to 98% for a medical reporting task.
The paper describes a submission to the WMT 2026 MIST shared task, using the Tiny Aya Global model with task-specialized QLoRA adapters for multilingual summarization and question answering.
A fine-tuned version of Gemma 4 12B that improves tool-calling reliability by 2.7x, optimized for consumer GPUs with 16GB VRAM using QLoRA training.
The article describes an individual who runs over 50 AI agents tuned for cybersecurity with a search index of CVEs, using a QLoRA-tuned GLM 5.2 model to continuously test production websites for vulnerabilities and earn money through bug bounties.
The paper compares five parameter-efficient fine-tuning methods on four small language models for on-device personalization, finding LoRA+ best for energy efficiency and QLoRA best for memory-limited deployment.
Soup is an open-source CLI that simplifies LLM fine-tuning and post-training with a single command, enabling QLoRA-based training on consumer GPUs with as little as 4 GB VRAM via layer streaming. The latest version adds preference losses like DPO, ORPO, SimPO, and KTO without doubling memory requirements.
This paper proposes a Damage Cause Encoder for bridge diagnostic agents that uses knowledge triple extraction from manuals and retrieval-augmented fine-tuning with QLoRA, achieving high accuracy with lower memory usage.
The author argues that the commonly recommended learning rate of 2e-4 for QLoRA fine-tuning is too high for datasets under 10k samples, leading to overfitting and poor evaluation, and suggests using a lower learning rate like 1e-4.
An ex-JPMorgan engineer behind the LLM Course offers an 18-minute guide on fine-tuning and merging models using LoRA, QLoRA, DPO, KTO, and mergekit, claiming it outperforms costly bootcamps.
Akwin123 fine-tuned Gemma-4-31B-it specifically for copywriting and creative writing tasks, achieving a +290 Elo improvement over the base model on a custom benchmark using QLoRA. The model is open-source and available on Hugging Face.
LoRA (low-rank adaptation) is the most popular parameter-efficient fine-tuning method for LLMs. This video introduces how LoRA and its variants (LoRA+, QLoRA, VeRA, DoRA) work.