arXiv:2606.15943 – Graphical-Probabilistic Modeling of Generative Flows in LLM-Native Software Systems

Note: This paper describes a (yet) non-peer-reviewed preprint on arXiv. The mentioned contents have not been independently verified by the scientific community so far.

What is it about?

Software that uses large language models (LLMs) as building blocks is often developed based on intuition: prompt engineering, experimentation, adjustment. A systematic vocabulary to describe such systems and predict their behavior is largely lacking. This is precisely where a current arXiv preprint comes in: it proposes a modeling approach called “Generation Networks” that connects software engineering concepts with graphical-probabilistic modeling.

The goal is to document the data flow and states of LLM-based software systems in such a way that their stochastic, prompt-dependent behavior can be formally captured – rather than just informally described. The starting point is the observation that LLM-supported applications can be understood as a sequence of transformations linked by a control logic. The preprint builds on this idea and shows how these transformations can be modeled probabilistically.

How does it work (simplified)?

The approach consists of several building blocks. First, systems are represented as so-called data-dependency graphs: directed, acyclic graphs whose nodes are typed data variables (inputs, outputs, internal intermediate values) and whose edges represent transformations. As an example, the paper shows in Figure 1 a hypothetical tool for root cause analysis with ten variables and five processing steps that combines summarization, information retrieval, and iterative reasoning. It distinguishes between two types of transformations – LLM-based steps that are stochastic and prompt-dependent, and algorithmic steps that are typically deterministic.

These graphs are then transformed into formal Bayesian networks, which represent the conditional dependencies between the variables and enable causal reasoning. Building on this, the preprint defines additional variable types for design properties: for instance, variables that disclose model parameters such as temperature or other hyperparameters, variables that distinguish different data collection regimes, as well as latent variables for ground truth or intermediate results.

On this basis, the authors define a specification language: first-order formulas over probabilistic quantities allow for expressing requirements, assurances, and search conditions – for example, regarding conditional probabilities (what happens given certain evidence) or intervention queries (what happens when one intervenes in the system, such as changing prompt parameters).

Instead of empirical experiments, the preprint demonstrates the expressive power of the approach through three use cases, which are presented as Figures 2 to 4 in the paper:

• Prescribing behavior: Expected behavior of a transformation can be formulated as a condition, such as a minimum accuracy value on a benchmark or a threshold for detecting out-of-distribution data.
• Exploring parameters: The search for an optimal prompt configuration – such as the appropriate number of few-shot examples – can be formalized as an intervention query.
• Documenting design improvements: Comparison metrics between different system variants (for example, a direct versus a multi-stage generation) can be expressed as probability statements about whether one variant improves upon the other without degrading elsewhere.

What is it good for / what does it bring?

The practical benefit lies less in a finished tool than in a common language: developers of LLM-based systems could communicate more precisely about what behavior a system should exhibit, what assumptions underlie an architectural decision, and how design alternatives can be quantitatively compared. This is relevant because many problems in building LLM applications – such as unpredictable behavior when changing prompts or hard-to-trace regressions during system modifications – are currently hardly described systematically.

By building on established probabilistic modeling (Bayesian networks), the approach can at least in principle be connected with existing tools and inference methods from this field, rather than requiring a completely new set of instruments.

Classification & Limitations

The preprint is exploratory and conceptual: no large-scale empirical studies are presented, but the three mentioned use cases serve as illustrations of the expressive power. It remains open, among other things, how labor-intensive it is in practice to fully model a real, complex LLM system as a data-dependency graph or Bayesian network, and how well the required probabilities can be estimated in practice.

Since this is a non-peer-reviewed preprint, the statements should be interpreted with appropriate caution until independent review is available.