@ManningBooks: Want to run AI locally? Explore small language models, CPU inference, quantization, and private AI apps with our free e…

X AI KOLs Timeline Products
local-ai small-language-models quantization cpu-inference ebook ollama llamacpp

Summary

Manning Books is offering a free ebook, 'Local AI and Small Language Models', featuring chapters on small language models, CPU inference with GGUF and llama.cpp, quantization, LoRA/DoRA specialization, and building private local AI apps with Ollama's Python library.

Want to run AI locally? Explore small language models, CPU inference, quantization, and private AI apps with our free ebook, Local AI and Small Language Models: https://hubs.la/Q04CXtH60 Featuring chapters from: • Domain-Specific Small Language Models by @GuglielmoIozzia • Build Applications with Local AI Models on a Mac by Keiji Kamigusa (@keiji_dl & @JoshuaKCage1) • Quantization and Fast Inference • Rearchitecting LLMs by @PereMartra
Original Article
View Cached Full Text

Cached at: 11/03/26, 02:34 PM

Want to run AI locally?

Explore small language models, CPU inference, quantization, and private AI apps with our free ebook, Local AI and Small Language Models: https://hubs.la/Q04CXtH60

Featuring chapters from: • Domain-Specific Small Language Models by @GuglielmoIozzia • Build Applications with Local AI Models on a Mac by Keiji Kamigusa (@keiji_dl & @JoshuaKCage1) • Quantization and Fast Inference • Rearchitecting LLMs by @PereMartra

Free eBook Local AI and Small Language Models

Source: https://blog.manning.com/free-ebook-local-ai-and-small-language-models?utm_campaign=56611736-Local_AI_and_Small_Language_Models&utm_content=388770917&utm_medium=social&utm_source=twitter&hss_channel=tw-24914741

Specialize, Optimize, and Deploy Privately

Choose a model that suits your task, adapt it to your needs, and build software that runs locally. This free eBook features four chapters from four Manning books, covering small language models, specialization with LoRA and DoRA, CPU inference with GGUF and llama.cpp, and application development through Ollama’s Python library. Get practical guidance on producing structured outputs, making informed quantization choices, and handling streaming responses and chatbot conversation history. Get a firmer grasp of the choices behind local AI as well as concrete techniques to try in your next project, without depending on a hosted inference service.

Similar Articles

@Zen_with_AI: I recommend a new book from @ManningBooks, “Domain-Specific Small Language Models: Efficient AI for local deployment,” “Domain-Specific Small Language Models: Efficient A…

X AI KOLs Timeline

I recommend Manning’s new book, *Domain-Specific Small Language Models: Efficient AI for local deployment* (by Guglielmo Iozzia, published in May 2026), which explains how to fine-tune small models on domain-specific data, quantize them, and deploy them on local hardware to achieve high-quality performance on specialized tasks. It also covers RAG and agent systems that rely solely on small models.