Deep reinforcement learning for optimal trading with partial information

By Andrea Macrì, Sebastian Jaimungal, Fabrizio Lillo

Rating

1832
Battle Count: 77

Relevance

9/10
Highly relevant to quantitative trading. The paper directly addresses optimal trading strategies with latent information, a core problem in algorithmic trading. It provides practical algorithms (DDPG variants) tested on both synthetic and real market data (pair trading). The findings about information quality and structure being crucial for RL-based trading are directly applicable to practitioners. The regime-switching OU model is a standard framework in statistical arbitrage and pairs trading.

Implementation Complexity

7/10
Moderate to high complexity. Requires implementing DDPG (Actor-Critic architecture), GRU networks, regime-switching OU process simulation, and the two-step training pipeline. The paper provides detailed algorithm pseudocode and hyperparameters. The pair trading application adds complexity with VAR estimation, Johansen cointegration testing, and Hamilton regime estimation. Multiple network architectures need to be trained and coordinated.

Reproducibility

3/5
The paper provides detailed algorithm descriptions (Algorithm 1), simulation parameters (Tables 1-3), network architectures, and hyperparameters. However, no code repository is mentioned. The synthetic data generation process is well-described, but the real data (LOBSTER database) requires external access. The pair trading application uses specific dates and assets (INTC, SMH) which are reproducible but time-sensitive.

About this paper

Methodology: DDPG with GRU for Optimal Trading under Partial Information. Problem types: Reinforcement Learning, Pairs Trading, Optimization, Time Series Forecasting, Classification, Algorithmic Execution.

The interactive Everscope explorer (charts, battles, favorites) loads below.