Machine Learning - Reference

• AI Links
  • Machine Learning Links
    • Neural Networks Links

• Neural networks in Reinforcement Learning

Reading

1. Accessible intro: A Brief History of Neural Nets and Deep Learning by Andrey Kurenkov (2020).

2. Paper by Turing Award winners: "Deep learning", Yann LeCun, Yoshua Bengio & Geoffrey Hinton, Nature volume 521, pages 436-444 (2015).

3. Survey: "Deep learning in neural networks: An overview", Jürgen Schmidhuber, Neural Networks, Volume 61, January 2015, Pages 85-117. (Has 14 pages of references!)

4. Earlier survey: "30 Years of Adaptive Neural Networks: Perceptron, Madaline, and Backpropagation". B. Widrow and M.A. Lehr. Proceedings of the IEEE, Volume: 78, Issue: 9, Sept 1990.

Books

1. Online book: Neural Networks - A Systematic Introduction, by Raúl Rojas, 1996.

2. An Introduction to Neural Computing, Igor Aleksander and Helen Morton, 2nd edn, 1995. DCU Library 006.3.ALE.

3. Machine Learning by Tom M. Mitchell, 1997.

4. Neural Networks in a Softcomputing Framework by Ke-Lin Du and M.N.S. Swamy, 2006.

Math

• Note - If multiply by negative, switch inequality:

  x < y
  -y < -x
  -x > -y
  

• factorial (and here)
• List of factorials

• MathWorld is good for quick definitions of things.
  • straight line
  • sin
  • period
  • e

• Differentiation
  • Chain Rule
  • Product Rule
  • Quotient Rule
  • Partial Derivative

Greek letters

letter	name	HTML symbol	usage
ς	sigma	ς	sigmoid function

Also:

symbol	HTML symbol	usage
∂	∂	partial derivative