Analyzing Generalization in Policy Networks: A Case Study with the Double-Integrator System

Extensive utilization of deep reinforcement learning (DRL) policy networks in diverse continuous control tasks has raised questions regarding performance degradation in expansive state spaces where the input state norm is larger than that in the training environment.