Diverse Approaches to Optimal Execution Schedule Generation

By Robert de Witt, Mikko S. Pakkanen

Rating

1557
Battle Count: 79

Relevance

9/10
Directly addresses optimal execution, a core problem in institutional quantitative trading affecting ~$1 trillion daily turnover. The PPO-CNN result (2.13 bps vs 5.23 bps VWAP slippage on $21B notional) represents a 59% improvement over industry benchmarks. The transient impact model calibration to 400+ US equities provides practical microstructure insights. The quality-diversity approach offers a novel paradigm for regime-adaptive execution. The GEO environment addresses a critical gap in reproducible execution research infrastructure. Highly relevant for buy-side execution desks, algorithmic trading firms, and market microstructure researchers.

Implementation Complexity

8/10
High complexity due to multiple interacting components: (1) transient impact model calibration via constrained non-linear least squares across 400+ stocks; (2) custom Gymnasium environment with vectorized simulation, order generation, and impact-adjusted fill pricing; (3) PPO training with two architectures (MLP and CNN) requiring careful hyperparameter tuning; (4) MAP-Elites implementation with archive management, Gaussian perturbation, and phenotype-matched evaluation; (5) 13-dimensional state space with running normalization; (6) multi-component reward function with 4 weighted terms. Requires expertise in RL, market microstructure, numerical optimization, and software engineering. The 5.5-hour MAP-Elites run on 16-core CPU indicates significant compute requirements.

Reproducibility

3/5
The authors plan to release GEO as an open-source Gymnasium environment with calibrated transient impact modeling, realistic order generation, and minute-bar execution. However, the repository is not yet available at time of publication. The methodology is well-documented with specific hyperparameters, data sources (Mana Tech), and evaluation protocols (strict train-test split: Jan-Sep 2022 training, Oct-Dec 2022 testing). The 3x3 MAP-Elites grid, Gaussian perturbation sigma=0.01, and 500-iteration budget are specified. Reproducibility is moderate as the data source (Mana Tech) is commercial and the full environment code is not yet released.

About this paper

Methodology: MAP-Elites Quality-Diversity with PPO in Calibrated Gymnasium Environment (GEO). Problem types: Reinforcement Learning, Algorithmic Execution, Optimization, Time Series Forecasting.

The interactive Everscope explorer (charts, battles, favorites) loads below.