@PyTorch: Muon has attracted a lot of attention for fast convergence, but getting those optimizers to work in a real training sta…
Summary
An announcement for a talk at PyTorch Conference North America covering practical implementations of Muon, Dion, and Dion3 optimizers in training stacks.
View Cached Full Text
Cached at: 09/18/26, 06:48 PM
Muon has attracted a lot of attention for fast convergence, but getting those optimizers to work in a real training stack is a different challenge.
At PyTorch Conference North America, @JenniferWe17599 will walk through Muon, Dion, and Dion3 and look at what happens when you add the messy details: sharding, communication, schedulers, and everything else that can go wrong.
If you are interested in optimizers and training dynamics, see you at PyTorchCon NA for Jen’s talk on Beyond AdamW: A Practical PyTorch Walkthrough of Muon, Dion, and Orthogonalized Optimizer Variants.
Get your ticket: https://hubs.la/Q04v4SL60
Register | PyTorch Conference North America
**Where what’s next in open source AI gets decided.**Don’t Miss Out!
PyTorch Conference Rates
The registration deadline is 11:59 PM Pacific Time on the respective date.
Attendee
Super Early BirdMar 31–Apr 10, 2026
Early BirdApr 11–Jul 31, 2026
StandardAug 1–Sep 4, 2026
LateSep 5–Oct 21, 2026
$ 999 USD
Academic*
Super Early BirdMar 31–Apr 10, 2026
Early BirdApr 11–Jul 31, 2026
StandardAug 1–Sep 4, 2026
LateSep 5–Oct 21, 2026
$ 249 USD
Bringing a Team? Purchase 10+ registrations at one time and receive a 25% discount. Contact[email protected]to claim your discount.
*Must provide proof of academic ID
What’s Included?
Your PyTorch Conference Registration Includes:
- All conference content – keynotes, conference sessions, panels, and more.
- Social Events & Networking Activities: Flare Party
- Community Expo entry
- Lunches, morning and afternoon coffee & snacks
- Event swag
- AI Community Bash featuring DE LA SOUL
Registration Types
**Academics:**Academic and student registrations are forcurrent full-timestudents, faculty/staff members. Those who qualify will need to upload a valid copy of their institution-issued ID showing the expiration date, current class transcript, OR proof of current employment showing they are a full-time student or faculty at the time of registration. If you have any questions, please contact[email protected].
Small Business: Our small business registration discount is available to companies that have less than $5 million in annual revenue AND less than 30 employees. Please contact us at[email protected]to request the Small Business Registration discount code.
Speakers: You should have received a registration link in your acceptance email. If you did not, please contact[email protected]for more details.
Sponsors: A registration link was shared in an email to your company’s sponsorship contact. Please reach out to your company’s sponsorship contact if you need to register as a Sponsor. For further questions, please email[email protected].
Media: If you are a member of the media interested in attending this event and have not received a complimentary access code to attend, please contact[email protected]and a member of our PR team will be in touch.
Additional Information
Quick Note: We never sell attendee lists or contact information, nor do we authorize others to do so. If you receive an email claiming to sell an attendee list for a Linux Foundation event, please forward it to[email protected].
Scholarships
Learn more aboutscholarship and travel fundingopportunities.
Invoices & Certificates of Attendance
Registration Invoices: Invoice receipts are downloadable from the confirmation email you received after registering under thePayment Receipt Informationsection. If the downloadable invoice receipt does not meet your needs or you need to have your confirmation email resent, pleasesubmit a request. Please include any additional customization you need for your invoice receipt in the request.
Certificates of Attendance: You can download your Certificate of Attendance directly from yourLFX dashboardby navigating to the “Past Events” section in the LF Events column.Please Note: We verify attendance through the registration system, and certificates will only be available for download after the event is completed.
Refund Policy
Cancellations: If you must cancel for any reason, pleasesign back into your registration, click the “Register/Modify” button, and select “Unregister.” Refunds will only be issued for cancellations received two weeks prior to the main event start date (including bulk ticket invoice requests, co-located events, and add-ons), and will appear as a credit on the card’s statement 7 – 10 business days after cancellation. Refunds can only be issued on the card the original payment was made.
Please note that all refunds are subject to a6% processing fee.
Substitutions: If you are unable to attend, you may substitute another attendee in lieu of cancellation. To substitute an attendee,sign back into your registration, click the “Register/Modify” button, and select “Transfer Registration” on your confirmation page. If you need further assistance, email[email protected].
Similar Articles
@PyTorch: At PyTorch Conference North America, explore how new optimizers like Muon and TorchJD work alongside tools like fastsaf…
The PyTorch Conference North America is announced, featuring sessions on new optimizers like Muon and TorchJD, tools like fastsafetensors and LMCache, with speakers from major tech companies and institutions, happening in San Jose on October 20-21.
@PyTorch: Train smarter. From distributed training to optimization techniques and foundation models, the Training Track at #PyTor…
The article promotes the Training Track at PyTorch Conference North America, featuring practical sessions on distributed training, optimization techniques, and foundation models to enhance AI system efficiency.
@burny_tech: some updates on the optimizer magic
A new NVIDIA paper proposes higher-order optimizers like Muon and SOAP as more efficient alternatives to AdamW for large-scale LLM pretraining.
Dion3: Full-Stack Orthogonal Updates
Dion3 is a revised Muon optimizer that reduces computational and communication overhead via Gram Newton-Schulz, symmetric GEMM kernels, and megabatching, achieving up to 6x faster optimizer steps while matching or improving loss.
@PyTorch: How do you train a 671-billion-parameter model across a thousand GPUs, and do it efficiently? Normally, finding the bes…
Promotes a talk at PyTorchCon North America where AMD's Primus Tuning Agent is demonstrated to efficiently train a 671-billion-parameter model across 1000 GPUs by predicting optimal configurations, saving compute time.