Multivariate Probability Models in Machine Learning [D]
Summary
A discussion thread on multivariate probability models in machine learning.
Similar Articles
MBDiff: Multi-view Behavior-aware Diffusion Model for Probabilistic Utility Data Imputation
Presents MBDiff, a multi-view behavior-aware diffusion model for probabilistic utility data imputation that learns user behavior from global, local, and instance-level views and uses a conditional attentional denoising network. Evaluated on real utility data from Florida, it outperforms state-of-the-art baselines.
@KirkDBorne: Machine Learning for Financial Risk Management with Python — Algorithms for Modeling Risk: http://amzn.to/3t7ARbG
Kirk Borne shares a book about machine learning for financial risk management with Python, highlighting how ML models can improve financial modeling and adapt to changing data patterns.
What is the point of MoE models, beyond being faster?
A discussion about the advantages of Mixture of Experts (MoE) models over dense models beyond speed, considering RAM constraints and scaling limits.
Get in here: Community model build thread
A thread proposing a method for creating a community AI model using crowdsourced compute via Branch-Train-Stitch to build a Mixture-of-Experts model from independently trained submodels, with discussion of hardware requirements, participant involvement, and technical challenges.
Semantic DLM+: Improving Diffusion Language Models through Bias-variance Trade-off in Transition Kernel Design
This paper theoretically analyzes diffusion language models through a bias-variance lens, identifying trade-offs between masking and uniform diffusion kernels. It proposes SemDLM+, which adds a global transition and semantic-frequency penalty to overcome the semantic basin problem, achieving competitive generation quality on LM1B and OpenWebText benchmarks.