PPDL: LLM-Based Flows as Probabilistic Programs

arXiv cs.LG Papers

Summary

This paper introduces PPDL, a probabilistic language for programming LLM-based flows that enables developers to quantify and propagate uncertainty throughout applications, with experimental and case studies on theorem proving.

arXiv:2608.05234v1 Announce Type: new Abstract: Building reliable applications that leverage large language models (LLMs) remains a significant challenge. While LLMs offer impressive capabilities across diverse tasks, their outputs often lack accuracy and provide no clear measure of confidence. This uncertainty compounds in flows of multiple calls to LLMs and other tools, making it difficult for developers and end-users to trust the results. This paper introduces a probabilistic language for programming LLM-based flows. It enables developers to quantify and propagate uncertainty throughout the application's flow, and experiment with different inference scaling techniques without adding a single line of code beyond the flow's logic. We present an experimental study to demonstrate this capability, and a case study building a theorem proving agent for the Rocq theorem prover.
Original Article
View Cached Full Text

Cached at: 08/07/26, 07:48 AM

# PPDL: LLM-Based Flows as Probabilistic Programs
Source: [https://arxiv.org/abs/2608.05234](https://arxiv.org/abs/2608.05234)
[View PDF](https://arxiv.org/pdf/2608.05234)

> Abstract:Building reliable applications that leverage large language models \(LLMs\) remains a significant challenge\. While LLMs offer impressive capabilities across diverse tasks, their outputs often lack accuracy and provide no clear measure of confidence\. This uncertainty compounds in flows of multiple calls to LLMs and other tools, making it difficult for developers and end\-users to trust the results\. This paper introduces a probabilistic language for programming LLM\-based flows\. It enables developers to quantify and propagate uncertainty throughout the application's flow, and experiment with different inference scaling techniques without adding a single line of code beyond the flow's logic\. We present an experimental study to demonstrate this capability, and a case study building a theorem proving agent for the Rocq theorem prover\.

## Submission history

From: Guillaume Baudart \[[view email](https://arxiv.org/show-email/b29d9212/2608.05234)\] **\[v1\]**Wed, 5 Aug 2026 13:37:25 UTC \(115 KB\)

Similar Articles