@Zen_with_AI: I recommend a new book from @ManningBooks, “Domain-Specific Small Language Models: Efficient AI for local deployment,” “Domain-Specific Small Language Models: Efficient A…
Summary
I recommend Manning’s new book, *Domain-Specific Small Language Models: Efficient AI for local deployment* (by Guglielmo Iozzia, published in May 2026), which explains how to fine-tune small models on domain-specific data, quantize them, and deploy them on local hardware to achieve high-quality performance on specialized tasks. It also covers RAG and agent systems that rely solely on small models.
View Cached Full Text
Cached at: 11/02/26, 02:00 AM
I recommend a new book from @ManningBooks, “Domain-Specific Small Language Models: Efficient AI for local deployment,” by Guglielmo Iozzia, published in May 2026.
The book’s premise is that, for specialized tasks, the enormous capacity of large models can sometimes get in the way. Small models trained on domain-specific data can deliver high-quality results on specific tasks, even when running on ordinary hardware.
The book has 15 chapters, structured around:
Fine-tuning -> Quantization -> Domain-specific generation -> Service deployment (Chapters 2 and 3 -> Chapters 5, 6, and 9, including ONNX -> Chapters 7 and 8, generating Python code and protein structures -> Chapters 11 through 15, including running on a laptop, RAG, and agents)
Two things stand out in the table of contents. First, it treats “getting it running on your own machine” as a goal, with dedicated chapters on quantization, performance profiling, secure APIs, and running on a laptop. Second, the book’s RAG systems and agents rely solely on small models, without the costs of calls to large foundation models. Suitable for AI engineers familiar with Python.
Book: https://amzn.to/4g7mVqW Andrej Karpathy’s learning resources on small models: https://drive.google.com/file/d/1Aw6vxDkjwE12T01UpD6FA5LZlDsc2tzn/view…
Domain-Specific Small Language Models: Efficient AI for local deployment: Iozzia, Guglielmo: 9781633436701: Amazon.com: Books
Source: https://www.amazon.com/dp/1633436705?lv=shuf&psc=1&linkCode=sl2&sp_csd=d2lkZ2V0TmFtZT1zcF9kZXRhaWw&pd_rd_i=1633436705&language=en_US&content-id=amzn1.sym.6c90551e-661c-4342-b5cf-431d897dc288&linkId=9552b82c305e0282c6300ee1136d4610&pd_rd_wg=VNW98&pd_rd_w=dfvkC&tag=kirkdborne-20&pd_rd_r=27f6bcc7-0a28-41a5-b54d-3907d2c37f04&channelId=1&ref_=as_li_ss_tl&plpRedirect=mhFallback
why this book?
Domain-Specific Small Language Modelsshows how to build compact AI models tuned to a specific industry, workflow, or dataset, rather than relying on oversized general-purpose LLMs.
Readers learn practical techniques for fine-tuning, evaluation, deployment, and optimization, enabling them to run capable models with lower latency, lower infrastructure costs, and tighter control over data and outputs.
The book also helps engineers understand when small language models outperform larger systems in production, especially in environments where privacy, speed, and reliability matter more than raw parameter count.
Similar Articles
@KirkDBorne: "Domain-Specific Small Language Models: Efficient AI for local deployment" available at https://amzn.to/4g7mVqW via @Ma…
Manning released "Domain-Specific Small Language Models: Efficient AI for local deployment" by Guglielmo Iozzia, covering how to build, fine-tune, evaluate, and deploy compact AI models tailored to specific industries and workflows for lower latency, cost, and better data control.
@ManningBooks: Want to run AI locally? Explore small language models, CPU inference, quantization, and private AI apps with our free e…
Manning Books is offering a free ebook, 'Local AI and Small Language Models', featuring chapters on small language models, CPU inference with GGUF and llama.cpp, quantization, LoRA/DoRA specialization, and building private local AI apps with Ollama's Python library.
@XAMTO_AI: Stop bookmarking those flashy but useless AI tutorials. This 'Hands-On Large Models' is what you really need—open source, free, and code that runs. The book covers 12 chapters, guiding you step by step through the complete workflow of deploying large models: ① Language Model Basics ② Prompt Engineering ③ Semantic Search ④ Model Fine-Tuning ⑤ Multimodal…
Recommend an open-source free tutorial 'Hands-On Large Models', covering 12 chapters including language model basics, prompt engineering, semantic search, model fine-tuning, multimodal applications, etc. All code can be run directly in Colab.
@wsl8297: Sharing an easy-to-read open-source book 'Foundations of Large Models'. From an introduction to large language models to architectural evolution, then to key technologies such as Prompt engineering, parameter-efficient fine-tuning, model editing, retrieval-augmented generation (RAG), all in one book. GitHub: https://github.com/ZJU-LLMs/…
The Zhejiang University team open-sourced an easy-to-understand textbook on large models 'Foundations of Large Models', covering from architectural evolution to key technologies like RAG, accompanied by the Agent-Kernel multi-agent framework.
@NFTCPS: Brothers, doing AI without large models is like doing nothing! Today I have to recommend an open-source masterpiece 'Foundations of LLMs' to you. Don't wait, just read it! This book doesn't beat around the bush—it goes deep from the start! From getting started with large language models to architectural evolution, and then it breaks down Prompt engineering, parameter-efficient fine-tuning, model editing, RAG (Retrieval-Augmented Generation) and other hardcore techniques in one go—a one-stop service.
This article promotes the open-source book 'Foundations of LLMs', which systematically explains knowledge about large language models, and introduces the multi-agent development framework Agent-Kernel.