In Parallel
Summary
In Parallel is an operating system for execution, designed to manage and coordinate parallel workflows and tasks.
Similar Articles
The Zen of Parallel Programming: The Posture of a Kernel
A blog post exploring parallel programming concepts through the lens of the HipKittens paper, focusing on the eight-wave ping-pong schedule that overlaps computation with memory movement on AMD GPUs, drawing philosophical parallels to Zen principles.
The Zen of Parallel Programming
A reflective essay connecting parallel programming concepts like communication and synchronization with Zen philosophy and human internal coordination.
@vivekgalatage: Introduction to Parallel Algorithms https://cs.cmu.edu/~guyb/paralg/paralg/parallel.pdf…
An introductory resource on parallel algorithms, covering fundamental concepts and techniques, from Carnegie Mellon University.
@YuvrajS9886: After Data Parallelism we move to Model Parallelism starting with Pipeline Parallelism The paper: GPipe: Easy Scaling w…
This thread explains GPipe, a paper on pipeline parallelism for scaling large models across multiple GPUs using micro-batching and activation checkpointing.
Rob Pike – 'Concurrency Is Not Parallelism' [video] (2012)
Rob Pike's 2012 talk explains the distinction between concurrency and parallelism, emphasizing that concurrency is about composition of independently executing tasks, while parallelism is about simultaneous execution. The talk is a classic in computer science education.