Perold, André. "Extreme Points and Basic Feasible Solutions in Continuous Time Linear Programming." SIAM Journal on Control and Optimization 19, no. 1 (1981): 52–63.

Linear programming (LP) has been very successful in obtaining structural insights and devising solution methods for stationary MDPs. However, an LP approach for nonstationary MDPs is currently missing ...