self-hosting

Tag

Cards List
#self-hosting

Ultra budget 20GB vram with 448GB/s for $100 bucks.

Reddit r/LocalLLaMA ↗ · 2026-07-11

Demonstrates achieving 20GB VRAM and 448GB/s bandwidth for around $100 using two NVIDIA P102-100 cards, running a llama.cpp server with a Qwen model and supporting 3 concurrent users with large context.

0 favorites 0 likes
#self-hosting

Why we're moving off Cloudflare Durable Objects

Hacker News Top ↗ · 2026-07-09 Cached

Wire, a platform for AI agent context containers, is migrating from Cloudflare Durable Objects to a custom runtime on Fly Machines due to structural limits: vector index separation, compute-data colocation, placement flexibility, and lack of self-hosting. The new architecture improves latency and enables dedicated capacity.

0 favorites 0 likes
#self-hosting

Why developers are ditching GitHub for Codeberg and self-hosting alternatives

Hacker News Top ↗ · 2026-07-09 Cached

Developers are increasingly moving from GitHub to platforms like Codeberg and self-hosting due to concerns over Microsoft's ownership, downtime, and political direction, with notable projects like Ghostty, Zig, and Tenacity leading the exodus.

0 favorites 0 likes
#self-hosting

Chatto is now open source

Hacker News Top ↗ · 2026-07-08 Cached

Chatto, a group chat application with end-to-end encryption and built-in voice/video calls, is now open source and available for self-hosting. A paid cloud hosting service, Chatto Cloud, is also announced for public beta.

0 favorites 0 likes
#self-hosting

@theo: GLM 5.2 is an incredible model. I wish people would stop pretending it is self-hostable and that it compares to Fable.

X AI KOLs Timeline ↗ · 2026-07-07 Cached

Theo praises GLM 5.2 as an incredible model but criticizes the notion that it is self-hostable and comparable to Fable, sparking debate about model accessibility.

0 favorites 0 likes
#self-hosting

@ArkhasFlow: Today, we've made an important... and completely crazy decision. ArkhasFlow is becoming fully Open Source. Yes, 100% Op…

X AI KOLs Timeline ↗ · 2026-07-05 Cached

ArkhasFlow, a professional trading platform, announces it is becoming fully open source, releasing all components including backend, frontend, and core infrastructure, allowing self-hosting with no dependency on the company.

0 favorites 0 likes
#self-hosting

My ASN Journey series (2024)

Hacker News Top ↗ · 2026-07-05 Cached

A comprehensive beginner's guide to obtaining and configuring your own ASN and IP addresses, covering BGP setup, costs, and limitations.

0 favorites 0 likes
#self-hosting

Serving Local AI on my Jetson through Durable Streams

Lobsters Hottest ↗ · 2026-06-30 Cached

A developer documents building a self-hosted text-to-speech app on an NVIDIA Jetson Orin Nano using Kokoro-82M and durable streams, enabling reliable local AI inference with shareable audio outputs.

0 favorites 0 likes
#self-hosting

@DeRonin_: My current local AI setup: - 2x DGX Spark linked (256gb) > GLM 5.2 @ 2bit, reasoning + agent loops - Mac Studio M3 Ultr…

X AI KOLs Following ↗ · 2026-06-30 Cached

A user describes their fully local AI stack using multiple hardware devices running Chinese models like GLM, Qwen, and Kimi, claiming 87% cost savings compared to frontier models like GPT-5.5 and Opus 4.8, while noting plans to self-host video generation.

0 favorites 0 likes
#self-hosting

@mubeitech: He built LiveJournal, invented the legendary Memcached, and worked at Google for a full decade. Then he quit. All to do one thing: rescue your photos, notes, files, and entire digital life from big tech servers and put them back on your own machine. This guy's name is Bra…

X AI KOLs Timeline ↗ · 2026-06-30 Cached

Brad Fitzpatrick left Google to develop Perkeep, an open-source personal data storage project that gives users full control over their digital data, freeing them from big tech cloud services. However, it is still in early stages and targets technical users.

0 favorites 0 likes
#self-hosting

Spindle's new microVM engine

Lobsters Hottest ↗ · 2026-06-29 Cached

Spindle introduces a new microVM engine that runs each workflow in its own lightweight virtual machine, supporting NixOS configuration, Docker builds, and caching for fast subsequent runs.

0 favorites 0 likes
#self-hosting

.self: A new top-level domain designed to support self-hosting

Hacker News Top ↗ · 2026-06-29 Cached

The Human-Centered Computing Foundation is campaigning to secure a new .self top-level domain dedicated to ethical, human-centered technology, aiming to support self-hosting and reclaim digital autonomy.

0 favorites 0 likes
#self-hosting

Self-hosting with llama-server? Fix for prompt cache reloading on every turn

Reddit r/openclaw ↗ · 2026-06-29

A troubleshooting guide showing how changing OpenClaw's contextInjection setting from 'always' to 'continuation-skip' fixes prompt cache reloading on every turn when using llama-server, resulting in a 100x speed improvement for long sessions.

0 favorites 0 likes
#self-hosting

I Don't Maintain My Homelab

Hacker News Top ↗ · 2026-06-29 Cached

The author describes how they automated their homelab to require minimal manual maintenance using a single server, UniFi networking gear, and Docker containers with scheduled updates and backups.

0 favorites 0 likes
#self-hosting

Set up your own DoH (DNS over HTTPS) service

Hacker News Top ↗ · 2026-06-27

A guide on setting up your own DNS over HTTPS (DoH) service to enhance privacy and security by encrypting DNS queries.

0 favorites 0 likes
#self-hosting

@TheAhmadOsman: Wanna replace Anthropic/OpenAI? START WITH THIS The bible for running LLMs locally is now available online to read for …

X AI KOLs Timeline ↗ · 2026-06-27 Cached

A comprehensive guide to running LLMs locally across various hardware and software setups is now available online for free, covering tools like llama.cpp, vLLM, and more.

0 favorites 0 likes
#self-hosting

Worse quality with MTP - Qwen 3.6, Gemma 4

Reddit r/LocalLLaMA ↗ · 2026-06-25

A user reports that MTP versions of Qwen 3.6 and Gemma 4 models produce lower quality outputs in code review tasks compared to non-MTP counterparts, with only marginal real-world speed improvements despite higher token generation rates.

0 favorites 0 likes
#self-hosting

@heynavtoor: There is an old laptop in your closet. Gathering dust. Dead battery. Slow processor. You keep it because you feel guilt…

X AI KOLs Timeline ↗ · 2026-06-23 Cached

CasaOS is a free, open-source system that turns old laptops or Raspberry Pis into a personal cloud server, replacing subscriptions like Netflix, Google Photos, Dropbox, and 1Password with self-hosted alternatives.

0 favorites 0 likes
#self-hosting

@exploraX_: https://x.com/exploraX_/status/2069352534280376665

X AI KOLs Timeline ↗ · 2026-06-23 Cached

A comprehensive 2026 guide to 30 powerful LLMs that are free to use, distinguishing between hosted platforms and self-hostable open-weight models, with detailed hardware requirements and license considerations.

0 favorites 0 likes
#self-hosting

@karminski3: Thinking of buying a Mac to run large models? This is a deterrent post. Actually, the estimation method is simple. Even if you buy a MacStudio to run the Qwen3.6-27B 4bit quantized version, then enable DFlash to use Qwen's built-in speculative decoding, it only reaches 65 token/s. And now most large models can run at 40 token/s…

X AI KOLs Timeline ↗ · 2026-06-22 Cached

The author calculates the token cost and break-even period of running large models on a Mac Studio, concluding that it is not cost-effective for ordinary users to buy a Mac for personal large model use, and suggests that using APIs or renting GPUs is more economical.

0 favorites 0 likes
← Previous
Next →
← Back to home

Submit Feedback