Nick's Notes
  • Sep 27, 2021

    Jupyter Notebook Server running in Ubuntu under WSL2 inaccessible from Windows 10 Pro

  • Feb 23, 2021

    Reductionism in Reinforcement Learning (2020)

  • Feb 18, 2021

    Work in Progress: Offline Reinforcement Learning: Tutorial, Review, and Perspectives on Open Problems (2020)

  • Jul 8, 2020

    Simulating Handwriting

  • Jul 6, 2020

    The Darkest Particles (2020)

  • Jul 3, 2020

    Work in Progress: Personal Energy Usage

  • Jul 1, 2020

    Reinforcement Learning in Robotics: A Survey (2013)

  • Jun 29, 2020

    Using Inaccurate Models in Reinforcement Learning (2006)

  • Jun 26, 2020

    The Limits of Growth

  • Jun 19, 2020

    The Difficulty of Cartpole

  • Jun 15, 2020

    Tabular Q-Learning for Cartpole

  • Jun 11, 2020

    Running a Genetic Algorithm on Cartpole

  • Jun 8, 2020

    Evolution Strategies as a Scalable Alternative to Reinforcement Learning (2017)

  • Jun 4, 2020

    Strang Lecture 17: Orthogonal Matrices and Gram-Schmidt

  • Jun 2, 2020

    Deep Neuroevolution: Genetic Algorithms are a Competitive Alternative for Training Deep Neural Networks for Reinforcement Learning (2018)

  • Jun 1, 2020

    Strang Lecture 16: Projection Matrices and Least Squares

  • May 29, 2020

    Strang Lecture 15: Projections onto Subspaces

  • May 28, 2020

    Strang Lecture 14: Orthogonal Vectors and Subspaces

  • Apr 30, 2020

    Strang Lecture 10: The Four Fundamental Subspaces

  • Apr 30, 2020

    Strang Lecture 9: Independence, Basis and Dimension

  • Apr 20, 2020

    Strang Lecture 8: Solving Ax = b: Row Reduced Form R

  • Apr 17, 2020

    A tutorial on the free-energy framework for modelling perception and learning (2017)

  • Apr 16, 2020

    Strang Lecture 7: Solving Ax = 0: Pivot Variables, Special Solutions

  • Apr 11, 2020

    The free-energy principle: a unified brain theory? (2010)

  • Apr 11, 2020

    Surfing Uncertainty, Chapter 3: The Imaginarium (2015)

  • Apr 11, 2020

    Strang Lecture 6: Column Space and Nullspace

  • Apr 8, 2020

    Introduction to Bayesian data analysis, Part 3: How to do Bayes? (2017)

  • Apr 8, 2020

    Introduction to Bayesian data analysis, Part 2: Why use Bayes? (2017)

  • Apr 8, 2020

    Introduction to Bayesian data analysis, Part 1: What is Bayes? (2017)

  • Apr 7, 2020

    Surfing Uncertainty, Chapter 2: Adjusting the Volume (2015)

  • Apr 3, 2020

    Six views of embodied cognition (2002)

  • Apr 3, 2020

    Surfing Uncertainty, Chapter 1: Prediction Machines (2015)

  • Mar 31, 2020

    Surfing Uncertainty: Introduction (2015)

  • Mar 31, 2020

    Memory engrams: Recalling the past and imagining the future (2020)

  • Mar 27, 2020

    Zoom In: An Introduction to Circuits (2020)

  • Mar 27, 2020

    Neural Networks are Surprisingly Modular (2020)

  • Mar 27, 2020

    Schema Networks: Zero-shot Transfer with a Generative Causal Model of Intuitive Physics (2017)

  • Mar 27, 2020

    Feynman Machine: The Universal Dynamical Systems Computer (2016)

  • Nick's Notes
  • nick@jalbert.io

Notes on readings related to reinforcement learning, neural nets, cognitive architectures, AI, linear algebra, and related topics.