Stochastic Action Value Gradients
Year: 2017
Type: preprint
Abstract: Stochastic off-policy actor-critic methods rely on approximating the policy gradient using the first term of the complete off-policy theorem. As noted by Degris et al (2012), the other term in the theorem, the stochastic action-gradient term, is difficult to estimate under the incremental off-policy setting. Using a compatible action-value function, we propose a method of estimating this term such that, similar to the first term, it also follows the approximate policy gradient.
Source: arXiv (Cornell University)
Authors: Yemi Okesanjo, Victor Kofia
Language: English
Subfield: Artificial Intelligence
Field: Computer Science
Domain: Physical Sciences
Open Access status: green
OpenAlex ID: W2592619258
