Tag
The article explains how GEPA (Genetic-Pareto Optimization) within DSPy is used for efficient prompt tuning, specifically applied to pretraining data curation at Microsoft AI, allowing researchers to replace manual prompt engineering with automated compute-driven optimization.
Microsoft AI CEO Mustafa Suleyman discusses the near-term possibility of superintelligence, the company's restructured relationship with OpenAI, and new frontier models, asserting that AI will not replace human jobs.
The tweet discusses Microsoft AI's use of Ray actors for training the MAI-Thinking-1 model, enabling finer granularity for heterogeneous compute and better CPU resource utilization in GPU clusters.
GEPA-optimized LLM judges from dspy are used for data filtering in Microsoft's MAI-Thinking-1 model pre-training pipeline.
Microsoft AI introduces MAI-Thinking-1, a 35B-active parameter reasoning model trained from scratch without distillation, achieving strong performance on software engineering and math benchmarks while emphasizing clean data and self-sufficiency.
Mustafa Suleyman, CEO of Microsoft AI, predicts that within 18 months, AI will automate most white-collar tasks involving computer work, including accounting, legal, and project management. The article discusses contrasting views on AI's actual impact on professional jobs.