mlops

Tag

Cards List
#mlops

@Necokeine: If you're not in the MaaS business, you might not be aware — DeepSeek's open-source DeepInfer is actually a framework that's been very deeply customized for DeepSeek 4.1F. For example, DeepInfer's task scheduling doesn't consider VRAM capacity at all. Why? Because DS 4.1F's KV cache is extremely optimized…

X AI KOLs Following ↗ · 2026-10-25 Cached

The discussion points out that DeepSeek's open-source DeepInfer is an inference framework deeply customized for DeepSeek 4.1F. Its KV cache is extremely optimized at just 890 bytes per token, meaning task scheduling never needs to account for VRAM capacity. In contrast, the Kimi series models have KV cache overhead 15–30x higher, resulting in poor inference performance and user experience.

0 favorites 0 likes
#mlops

Show HN: Strot – Compile an LLM's intent once, run decisions locally forever

Hacker News Top ↗ · 2026-10-19 Cached

Show HN: STROT,一个开源「决策编译器」,用 LLM 编译一次意图,之后在本地以 144M 小模型零成本执行分类、评分与路由决策,附带校准与置信度门控保证。

0 favorites 0 likes
#mlops

Flama: 8 years building a Python framework where ML models and LLMs are first-class, now written up on arXiv [P]

Reddit r/MachineLearning ↗ · 2026-10-13

作者介绍 Flama——一个将 ML 模型和 LLM 作为一等公民的 Python 框架,八年间从模型部署发展到 2.0 支持 LLM,并与 Miguel Durán-Olivencia 一起将整体架构写成一篇 83 页的 arXiv 论文。模型被打包为单一 .flm 文件,支持 vLLM/MLX 后端以及 OpenAI、Anthropic、Ollama 等多种协议。

0 favorites 0 likes
#mlops

@GYLQ520: I've chewed through a ton of model training, but when it actually comes time to go live, I don't even know where to sta…

X AI KOLs Timeline ↗ · 2026-09-30 Cached

Harvard's open-source textbook *Machine Learning Systems*, derived from CS249R, covers building and deploying ML systems — from single-machine setups to distributed training, data, deployment, and monitoring — and ships with TinyTorch, a ~20-module framework for building a minimal trainable system from tensors up.

0 favorites 0 likes
#mlops

How I changed teaching after AI managed to do all my homework assignments

Hacker News Top ↗ · 2026-09-24 Cached

An educator describes how they redesigned assessments in their Machine Learning in Production course after AI tools like GPT-3 could complete homework assignments, shifting focus to interactions, exams, and demos while allowing AI use.

0 favorites 0 likes
#mlops

Senior/Lead AI engineers: what portfolio project actually makes you say "this person knows production"?

Reddit r/AI_Agents ↗ · 2026-09-23

An aspiring AI engineer seeks advice from senior professionals on which portfolio project best demonstrates production skills, proposing ideas like LLM routing services, agent systems with guardrails, and local inference microservices, while asking for feedback on common gaps in portfolios.

0 favorites 0 likes
#mlops

@_avichawla: DevOps vs. MLOps vs. LLMOps, clearly explained: Many teams are trying to apply DevOps practices to LLM apps. But DevOps…

X AI KOLs Timeline ↗ · 2026-08-23 Cached

The article explains the key differences between DevOps, MLOps, and LLMOps, highlighting how each addresses distinct challenges in software development, machine learning, and LLM applications, with a focus on unique monitoring and optimization in LLMOps.

0 favorites 0 likes
#mlops

@svpino: This looks pretty interesting: An end-to-end system to build, evaluate, deploy, monitor, and continuously improve your …

X AI KOLs Timeline ↗ · 2026-08-11 Cached

Santiago Valdarrama highlights an end-to-end system for building, evaluating, deploying, and monitoring specialized AI models, noting that enterprises are willing to pay for custom small models despite the popularity of foundation models.

0 favorites 0 likes
#mlops

@KirkDBorne: Managing Machine Learning Projects from Design to Deployment: http://amzn.to/4vTeq7K +and+ Machine Learning Design Patt…

X AI KOLs Timeline ↗ · 2026-08-10 Cached

Tweet promoting two machine learning books: Managing Machine Learning Projects and Machine Learning Design Patterns, with a detailed description of the former for project management techniques.

0 favorites 0 likes
#mlops

@DailyDoseOfDS_: 4 strategies to test ML models in production:

X AI KOLs Timeline ↗ · 2026-08-09 Cached

Shares a link to strategies for testing machine learning models in production, aimed at ML practitioners.

0 favorites 0 likes
#mlops

@julien_c: “Your data lives on Hugging Face. Your compute runs on Vast GPUs.” I love this!!

X AI KOLs Timeline ↗ · 2026-08-06 Cached

vast.ai now supports Hugging Face Storage Buckets as a cloud connection, allowing rented GPU instances to pull datasets and checkpoints directly from HF buckets and push results back without manual transfers.

0 favorites 0 likes
#mlops

Evaluation Blindness: How Silent Measurement Failures Corrupt AI Systems from Training to Deployment

arXiv cs.LG ↗ · 2026-08-05 Cached

This paper introduces 'evaluation blindness,' a formal framework for silent measurement failures that corrupt AI systems from training to deployment, with case studies, a failure taxonomy validated on 50 real incidents, and a failure budget framework.

0 favorites 0 likes
#mlops

AIGen: Automating AI Bill of Materials Generation Through Hybrid MLOps Integration

arXiv cs.LG ↗ · 2026-07-30 Cached

AIGen is a modular tool that automatically generates SPDX 3.0-compliant AI Bills of Materials (AIBoMs) by integrating MLOps frameworks with LLMs, enabling transparent AI supply chain governance and regulatory compliance.

0 favorites 0 likes
#mlops

@anacondainc: Metaflow's philosophy is to eliminate complexity while supporting production-scale ML/AI. See how its composable APIs, …

X AI KOLs Timeline ↗ · 2026-07-28 Cached

Anaconda highlights Metaflow's design philosophy and core features, emphasizing its simplicity, composability, and enterprise-ready capabilities for production ML/AI workflows.

0 favorites 0 likes
#mlops

Training data needs a real go/no-go gate before training [D]

Reddit r/MachineLearning ↗ · 2026-07-27

The author proposes a formal pre-training control layer that audits training data artifacts and provides a verdict (PASS/FAIL) based on explicit criteria, as a missing gate between data preparation and training, and invites discussion on its practicality.

0 favorites 0 likes
#mlops

ModelExpress: Distributing Model Artifacts at the Speed of Light - NVIDIA Technical Blog

Reddit r/LocalLLaMA ↗ · 2026-07-25

NVIDIA introduces ModelExpress, a solution for rapidly distributing AI model artifacts, as described in their technical blog.

0 favorites 0 likes
#mlops

One pattern we're seeing in AI implementations: the model isn't the bottleneck anymore.

Reddit r/ArtificialInteligence ↗ · 2026-07-24

Observers note that in AI deployments, the model performance is no longer the primary limiting factor; challenges now revolve around infrastructure, data, and integration.

0 favorites 0 likes
#mlops

@anyscalecompute: Ray Summit 2026, presented with @vllm_project. Thank you to the partners and sponsors behind three days in SF, Aug 24–2…

X AI KOLs Following ↗ · 2026-07-21 Cached

Announcing Ray Summit 2026, co-presented with vLLM, taking place August 24-26 in San Francisco. The full agenda is live, featuring tracks on foundation model training, multimodal pipelines, and RL at scale.

0 favorites 0 likes
#mlops

Unsolved Problems in MLOps

Hacker News Top ↗ · 2026-07-15

An article discussing unresolved challenges in the field of MLOps, covering operational hurdles in deploying and maintaining machine learning systems.

0 favorites 0 likes
#mlops

@suraj_sharma14: If you want to become an AI/ML Engineer, here's what you actually need to learn: - Math & theory foundations : Linear a…

X AI KOLs Timeline ↗ · 2026-06-25 Cached

A detailed roadmap of topics to learn for becoming an AI/ML engineer, covering math fundamentals, deep learning architectures, training techniques, data pipelines, evaluation, inference, MLOps, and responsible AI.

0 favorites 0 likes
Next →
← Back to home

Submit Feedback