LOB-Impact Benchmark: Emergent Market Impact in Generative Limit Order Book Models

By George Nigmatulin, Valentin Mohl, Sascha Frey, Kang Li, Aramis Marti-Shahandeh, Mihai Cucuringu, Anisoara Calinescu, Jakob Foerster, Stefan Zohren

Rating

1830
Battle Count: 50

Relevance

10/10
Highly relevant for algorithmic trading, specifically for the development and validation of execution algorithms and RL-based trading agents. It addresses a critical gap in evaluating whether simulators correctly model the cost of trading (market impact).

Implementation Complexity

8/10
Requires implementing a complex benchmark protocol involving metaorder injection, blind controls, and specific statistical estimators for impact laws. Requires access to high-frequency LOB data and computational resources for running generative models.

Reproducibility

5/5
The benchmark is released as open source (GitHub repository provided). The methodology, calibration, and estimators are fully described. Data used is LOBSTER data for specific stocks in January 2026, which is publicly available.

Abstract

Realistic market impact is essential for generative limit order book (LOB) models to serve as world models for trading agents. If a simulator misprices this mechanism, agents learn policies that are optimal in the simulator but wrong in the real market. Existing metrics assess generated streams purely through distributional comparison with historical data, leaving counterfactual response to an agent's own orders largely unexplored. Here, we show that market impact emerges naturally in neural LOB generators trained solely for next-token prediction. We inject execution-style metaorders into the generated message flow of five autoregressive models across five NASDAQ stocks and measure the response using estimators from the empirical impact literature, validated on baselines whose physics is known in advance. Our benchmark evaluates any message-level generator in three phases: free generation (reading order-flow persistence against price diffusivity); metaorder injection (yielding the impact law's exponent and amplitude); and a post-execution window (measuring relaxation). In addition, comparing each visible injection to a blind, simulator-only control isolates the model's learned response from standard book mechanics. For every model on every stock, we measure how the impact responds as a function of cumulative metaorder participation. Interestingly, we observe emergent impact in generative models of market data, with exponents in the range of 0.63 to 1.21, slightly above the traditional 0.5 of the square-root law of impact. In the family of models tested, we are so far unable to observe impact decay during relaxation. We tentatively attribute this to the still-short context windows of the models. We release the benchmark as open source to validate future generative models for market data.

The interactive Everscope explorer (charts, battles, favorites) loads below.