self-hosted-llm

Tag

Cards List
#self-hosted-llm

Notes on gotchas while migrating 35kb preprompts from Opus to self-hosted Ollama

Hacker News Top ↗ · 2026-09-14 Cached

A blog post discussing the challenges and ethical reasons for migrating 35kb prompts from Anthropic/OpenAI to self-hosted Ollama, focusing on privacy and security concerns with cloud providers.

0 favorites 0 likes
#self-hosted-llm

From Production Traffic to Post-Training: Building a Self-Hosted LLM That Covers the Corporate Request Mix

Hugging Face Daily Papers ↗ · 2026-09-01 Cached

A research paper presents a method for training a smaller self-hosted LLM using separate GRPO experts merged via SLERP, which outperforms a larger baseline on enterprise tasks and serves half of platform traffic at lower cost.

0 favorites 0 likes
← Back to home

Submit Feedback