Artificial Intelligence Asked by lll on December 18, 2020
I am new to reinforcement learning, but, for a finite horizon application problem, I am considering using the average reward instead of the sum of rewards as the objective. Specifically, there are a total of $T$ maximally possible time steps (e.g., the usage rate of an app in each time-step), in each time-step, the reward may be 0 or 1. The goal is to maximize the daily average usage rate.
Episode length ($T$) is maximally 10. $T$ is the maximum time window the product can observe about a user’s behavior of the chosen data. There is an indicator value in the data indicating whether an episode terminates. From the data, it is offline learning, so in each episode, $T$ is given in the data. As long as an episode doesn’t terminate, there is a reward of ${0, 1}$ in each time-step.
I heard if I use an average reward for the finite horizon, the optimal policy is no longer a stationary policy, and optimal $Q$ function depends on time. I am wondering why this is the case.
I see normally, the objective is defined maximizing
$$sum_t^T gamma^t r_t$$
And I am considering two types of average reward definition.
$1/T(sum^?_{t=0}gamma^t r_t)$, $T$ varies is in each episode.
$1/(T-t)sum^T_{i=t-1}gamma^i r_i$
0 Asked on December 18, 2020 by lll
1 Asked on December 15, 2020
alphago alphago zero monte carlo tree search neural networks reinforcement learning
1 Asked on December 13, 2020 by k-do
1 Asked on December 9, 2020 by kais-hasan
0 Asked on December 9, 2020 by murugesh
1 Asked on December 7, 2020 by zahra
actor critic methods hyperparameter optimization reinforcement learning soft actor critic tensorflow
1 Asked on December 5, 2020
2 Asked on December 3, 2020 by mscott
0 Asked on December 3, 2020 by edwin-carlsson
1 Asked on December 2, 2020 by alena-volkova
3 Asked on November 30, 2020 by mithical
0 Asked on November 30, 2020 by dimer
3 Asked on November 18, 2020 by user91411
0 Asked on November 18, 2020 by basile-starynkevitch
1 Asked on November 7, 2020 by duttaa
0 Asked on October 30, 2020 by kosmos
1 Asked on October 12, 2020 by petsol
convolution filters convolutional neural networks deep learning machine learning neural networks
1 Asked on September 27, 2020 by ali-khalili
deep learning loss loss functions neural networks regularization
1 Asked on September 23, 2020 by user2946825
0 Asked on September 20, 2020 by andreas-torester
deep learning gpt natural language processing tensorflow training
Get help from others!
Recent Answers
© 2022 AnswerBun.com. All rights reserved. Sites we Love: PCI Database, MenuIva, UKBizDB, Menu Kuliner, Sharing RPP