Переглянути джерело

Not learning rate but discount factor

Martin Thoma 9 роки тому
батько
коміт
ea63ce4d57

BIN
source-code/Pseudocode/Value-Iteration/Value-Iteration.png


+ 1 - 1
source-code/Pseudocode/Value-Iteration/Value-Iteration.tex

@@ -23,7 +23,7 @@
         \Statex Actions $\mathcal{A} = \{1, \dots, n_a\},\qquad A: \mathcal{X} \Rightarrow \mathcal{A}$
         \Statex Cost function $g: \mathcal{X} \times \mathcal{A} \rightarrow \mathbb{R}$
         \Statex Transition probabilities $f$
-        \Statex Learning rate $\alpha \in [0, 1]$, typically $\alpha = 0.1$
+        \Statex Discounting factor $\alpha \in (0, 1)$, typically $\alpha = 0.9$
         \Procedure{ValueIteration}{$\mathcal{X}$, $A$, $g$, $f$, $\alpha$}
             \State Initialize $J, J': \mathcal{X} \rightarrow \mathbb{R}_0^+$ arbitrarily
             \While{$J$ is not converged}