Deep Reinforcement Learning for Automated Stock Trading: An Ensemble Strategy

By Hongyang Yang, Xiao-Yang Liu, Shan Zhong, Anwar Walid

Rating

1526
Battle Count: 170

Relevance

9/10
Highly relevant to quantitative trading. Directly addresses automated stock trading strategy design using deep RL. Provides practical ensemble approach for adapting to different market regimes. Includes realistic constraints (transaction costs, liquidity, risk management via turbulence index). Demonstrates outperformance over DJIA and min-variance portfolio. Open-source implementation available for practical deployment.

Implementation Complexity

7/10
Moderate to high complexity. Requires implementing three RL algorithms (PPO, A2C, DDPG) with actor-critic architectures, building a custom trading environment with 181-dimensional state space and continuous action space, implementing rolling window retraining and validation, incorporating turbulence index for risk management, and managing memory with load-on-demand technique. However, leverages existing frameworks (OpenAI Gym, Stable Baselines) and provides open-source code.

Reproducibility

4/5
The paper is fully open-sourced on GitHub with code available. Uses standard Dow Jones 30 stocks data from Compustat/WRDS. Employs well-known RL algorithms (PPO, A2C, DDPG) via Stable Baselines and OpenAI Gym. However, specific hyperparameters and training details may require additional configuration. The rolling window retraining procedure is clearly described.

About this paper

Methodology: Ensemble Deep Reinforcement Learning for Stock Trading. Problem types: Reinforcement Learning, Portfolio Optimization, Algorithmic Execution, Risk Management, Optimization.

The interactive Everscope explorer (charts, battles, favorites) loads below.