distributed-computing

Tag

Cards List
#distributed-computing

Manifold-Aware General Coded Computing for Straggler-Resilient Distributed Computing

arXiv cs.LG ↗ · 2026-09-02 Cached

This paper proposes a manifold-aware encoding strategy for general coded computing that exploits the intrinsic low-dimensional geometry of high-dimensional data to improve straggler resilience in distributed systems. Experiments show reduced mean squared recovery error in neural network inference and polynomial evaluation tasks.

0 favorites 0 likes
#distributed-computing

@PyTorch: PyTorch 2.14 introduces updates to Inductor, PyTorch Distributed, c10d, dynamic shapes, Apple Silicon, and accelerator …

X AI KOLs Timeline ↗ · 2026-09-01 Cached

PyTorch 2.14 introduces updates to Inductor, PyTorch Distributed, dynamic shapes, Apple Silicon support, and more, with a live Q&A and PyTorchCon announcement.

0 favorites 0 likes
#distributed-computing

Learning-Theoretic Foundation for General Coded Computing: The Straggler Setting

arXiv cs.LG ↗ · 2026-09-01 Cached

This paper introduces General Coded Computing (GCC), a learning-theoretic framework for mitigating stragglers in distributed computing systems, providing theoretical performance guarantees and experimental validation on deep neural networks.

0 favorites 0 likes
#distributed-computing

Parallelizing Transformer Training (39 minute read)

TLDR AI ↗ · 2026-08-21 Cached

An interactive, explorable explanation of various parallelization schemes for training transformers, adapted from academic content on scaling models.

0 favorites 0 likes
#distributed-computing

Understanding the limitations of Pubsub systems

Lobsters Hottest ↗ · 2026-08-20

This article explores the limitations of Pubsub systems, focusing on challenges in distributed computing environments.

0 favorites 0 likes
#distributed-computing

apra-fleet

Product Hunt ↗ · 2026-08-11

apra-fleet is a tool that lets you run a fleet of AI agents across your machines.

0 favorites 0 likes
#distributed-computing

Running coding agents on 2+ machines taught me the hard part isn't the agents, it's the control plane

Reddit r/AI_Agents ↗ · 2026-07-24

Running coding agents across multiple machines reveals that managing the control plane is more challenging than the agents themselves, offering insights into distributed agent orchestration.

0 favorites 0 likes
#distributed-computing

RL post-training on 14 Macs across 4 countries

Reddit r/LocalLLaMA ↗ · 2026-07-15

A technical note on performing RL post-training across 14 Macs distributed in 4 countries, highlighting distributed compute for reinforcement learning.

0 favorites 0 likes
#distributed-computing

@h100envy: Prime Intellect engineers explained how they train reasoning models over the open internet in 30 minutes - better than …

X AI KOLs Timeline ↗ · 2026-07-12 Cached

Prime Intellect engineers demonstrated a method to train reasoning models in 30 minutes using distributed RL over the open internet, utilizing Prime-RL, LLM judges, and multi-cloud GPUs, enabling open models to compete with closed labs without owning data centers.

0 favorites 0 likes
#distributed-computing

Mesh LLM: distributed AI computing on iroh

Hacker News Top ↗ · 2026-07-11 Cached

Mesh LLM is a distributed AI computing platform that pools idle GPUs across multiple machines to run large language models, exposing a single OpenAI-compatible API. It leverages iroh's peer-to-peer networking to enable private, decentralized inference without a central server.

0 favorites 0 likes
#distributed-computing

Seti@home redux possible solution for database crunch?

Reddit r/ArtificialInteligence ↗ · 2026-07-10

The article revisits the SETI@home distributed computing model as a potential solution to alleviate the demand for new database centers by utilizing idle office and home PCs for processing tasks.

0 favorites 0 likes
#distributed-computing

Distributed Sketching on Data Partitions for OLS Regression

arXiv cs.LG ↗ · 2026-07-10 Cached

This paper investigates distributed sketching for OLS regression, where sketches are built from partitioned subsets rather than the whole dataset, reducing computational cost. The authors characterize the exact excess loss of the averaged estimator and show it matches that of whole-data sketching when subset covariance divergence is small.

0 favorites 0 likes
#distributed-computing

@raydistributed: We just released Ray 2.56! This includes - Ray Data stability improvements: reduced object store spilling, automatic ba…

X AI KOLs Following ↗ · 2026-06-30

Ray 2.56 has been released with improvements to Ray Data, Ray Serve for LLMs, GPU-domain-aware placement groups, and Kubernetes integration.

0 favorites 0 likes
#distributed-computing

Programmable Probabilistic Computer with 1M p-bits

Hacker News Top ↗ · 2026-06-28 Cached

This paper presents a programmable probabilistic computer with one million p-bits by networking FPGAs, achieving Gibbs sampling at over a trillion flips per second for Ising models while introducing a design rule for scaling beyond single-chip limits.

0 favorites 0 likes
#distributed-computing

Hunting Million-Digit Primes from My Loft

Hacker News Top ↗ · 2026-06-21

A personal account of hunting for million-digit prime numbers using a home computer setup.

0 favorites 0 likes
#distributed-computing

Could AI training be decentralized like Bitcoin mining? [D]

Reddit r/MachineLearning ↗ · 2026-06-15

A discussion explores whether AI training could be decentralized like Bitcoin mining, with participants contributing GPU resources to train open-source models in exchange for tokens, raising questions about verification, fake gradients, and efficiency.

0 favorites 0 likes
#distributed-computing

21 years and counting of 'eight fallacies of distributed computing' (2025)

Hacker News Top ↗ · 2026-06-15 Cached

A retrospective on the eight fallacies of distributed computing, originally formulated by Sun Microsystems engineers, examining their continued relevance 21 years later for network operators and developers.

0 favorites 0 likes
#distributed-computing

@raydistributed: Congratulations to the Microsoft AI team on MAI-Thinking-1! Exciting to see Ray used in multiple parts of frontier-mode…

X AI KOLs Following ↗ · 2026-06-04 Cached

Microsoft AI announces MAI-Thinking-1, a 35B active/1T total MoE reasoning model competitive on STEM and coding tasks, developed using Ray for distributed training and orchestration.

0 favorites 0 likes
#distributed-computing

What are important data systems problems, ignored by research? (2024)

Lobsters Hottest ↗ · 2026-05-29 Cached

A blog post summarizing a panel at the Dutch-Belgian DataBase Day, which discussed practical data systems problems often ignored by academic research, such as variable-length string handling, unrealistic benchmarks, and networking challenges.

0 favorites 0 likes
#distributed-computing

@raydistributed: Try out Ray-powered batch inference on Snowflake

X AI KOLs Following ↗ · 2026-05-21 Cached

Snowflake now supports job-based batch inference powered by Ray, enabling distributed GPU execution for scaling model inference over millions of unstructured datapoints with a single API call.

0 favorites 0 likes
← Previous
Next →
← Back to home

Submit Feedback