How do I test an LSTM-based reinforcement learning model using any Atari games in OpenAI gym?

Question

I am writing a couple of different reinforcement learning models based on Rainbow DQN or some PG models. All of them internally use an LSTM network because my project is using time series data.
I wanted to test my models using OpenAI Gym before I add too many domain specific code to the models.
The problem is that, all of the Atari games seem to fall into the CNN area which I don't use.
Is it possible to use OpenAI Gym to test any time series data driven RL models/networks?
If not, is there any good environment that I can use to examine the validity of my models?

harwiltz · Answer

If I understand your problem correctly, you can test on just about any environment, and just omit parts of the observations to ensure your RNN is learning. For example, you can test on cartpole, ignoring the velocity and angular velocity states. This way the MDP isn't actually Markovian and you'll need the RNN to learn.

Answered by harwiltz on November 10, 2021

How do I test an LSTM-based reinforcement learning model using any Atari games in OpenAI gym?

One Answer

Add your own answers!

Related Questions

Why are Target Networks used in Deep Q-Learning as opposed to the Expected Value equation?

Handling a Large Discrete Action Space in Deep Q Learning

What are the advantages and disadvantages of using LISP for constraint satisfaction in 3D space

Local Search vs K-means Clustering

What are the right algorithms for this open loop control problem

What is the state of the art solution for text classification for large corpora

Non Max Suppression and Object Detection

Isn’t a simulation a great model for model-based reinforcement learning?

Correct problem statement for CNN. Stitching parts of the map

How can I predict the true label for data with incomplete features based on the trained model with data with more features?

Why is Symbolic AI not so popular as ANN but used by IBM Deep Blue?

Ask a Question