Reinforcement Learning - Reference

• AI Links
  • Reinforcement Learning
  • Neural Networks

• RL course by Yishay Mansour
  • Convergence of Q-learning

• Wikipedia
  • DP
  • MDP
  • Partially observable MDP
  • RL
  • Q-learning

• Scholarpedia
  • RL
  • TD learning

Mathematics

• MathWorld is good for quick definitions of things.
  • quadratic equations
  • e

Greek letters

letter	name	HTML symbol	usage in RL
α	alpha	α	learning rate
γ	gamma	γ	discounting factor

Reading

• Clocksin, William F. and Moore, Andrew W. (1989), Experiments in Adaptive State-Space Robotics, Proceedings of the 7th Conference of the Society for Artificial Intelligence and Simulation of Behaviour (AISB-89).
  A simple introduction to the very idea of state-space robotic or agent control.

• How to Make Software Agents Do the Right Thing: An Introduction to Reinforcement Learning, Singh et al, 1996.
  A simple introduction to the idea of RL.

• Kaelbling, Leslie Pack; Littman, Michael L. and Moore, Andrew W. (1996), Reinforcement Learning: A Survey, Journal of Artificial Intelligence Research 4:237-285.

• Action Selection methods using Reinforcement Learning. My PhD thesis, 1997.
  • Ch.2. Reinforcement Learning

Books

• Reinforcement Learning: An Introduction, Richard S. Sutton and Andrew G. Barto, 2nd edn, 2015.

• Reinforcement Learning: State-of-the-Art, Marco Wiering and Martijn Otterlo (Editors), 2012.