소스 검색

Not learning rate but discount factor

Martin Thoma 9 년 전
부모
커밋
ea63ce4d57
2개의 변경된 파일1개의 추가작업 그리고 1개의 파일을 삭제
  1. BIN
      source-code/Pseudocode/Value-Iteration/Value-Iteration.png
  2. 1 1
      source-code/Pseudocode/Value-Iteration/Value-Iteration.tex

BIN
source-code/Pseudocode/Value-Iteration/Value-Iteration.png


+ 1 - 1
source-code/Pseudocode/Value-Iteration/Value-Iteration.tex

@@ -23,7 +23,7 @@
         \Statex Actions $\mathcal{A} = \{1, \dots, n_a\},\qquad A: \mathcal{X} \Rightarrow \mathcal{A}$
         \Statex Cost function $g: \mathcal{X} \times \mathcal{A} \rightarrow \mathbb{R}$
         \Statex Transition probabilities $f$
-        \Statex Learning rate $\alpha \in [0, 1]$, typically $\alpha = 0.1$
+        \Statex Discounting factor $\alpha \in (0, 1)$, typically $\alpha = 0.9$
         \Procedure{ValueIteration}{$\mathcal{X}$, $A$, $g$, $f$, $\alpha$}
             \State Initialize $J, J': \mathcal{X} \rightarrow \mathbb{R}_0^+$ arbitrarily
             \While{$J$ is not converged}