Sitemap

Reinforcement Learning

A series of tutorials on reinforcement learning, mainly for robotics applications.

Data science dictionary

40 min read

A non-exhaustive list of definitions of data science terms.

Deep learning

Learn about deep neural networks, starting from the basics.

Optimisation

A blog series is about optimisation, including evolutionary optimisation and Bayesian optimisation.

Supervised learning

Learn to use supervised learning for classification and regression problems

Cheat sheets

A number of handy cheat sheets to remember commands and syntax for various programming tools.

Anomaly detection for time series

A review of the different anomaly detection approaches for time series data.

About

The person behind the scene.

Comment Policy

Some general rules to leave a comment via Disqus

Terms and Privacy Policy

Privacy policy and terms and conditions.

Page Not Found

Page not found. Your pixels are in another canvas.

Posts by Category

A blog on applied machine learning and data science.

Sitemap

Vim cheat sheet

1 min read

Some useful commands and shortcuts for the Vim text editor

ROS cheat sheet

4 min read

Some useful commands and shortcuts for ROS

Markdown cheat sheet

less than 1 min read

Some useful syntax for the Markdown format

Linux bash cheat sheet

5 min read

Some useful commands and shortcuts for the Linux Bash command line interpreter

Git cheat sheet

1 min read

Some useful commands and shortcuts for the Git version-control system

Docker cheat sheet

1 min read

Some useful commands and shortcuts for Docker

Conda cheat sheet

1 min read

Some useful commands and shortcuts for Conda

Part 3 - Optimisation libraries

3 min read

A comparison of some popular optimisation frameworks

Part 2 - A simple genetic algorithm in Python

1 min read

Understand how genetic algorithms work and implement a simple one in Python

Part 1 - Optimisation algorithms

3 min read

A non-exhaustive list of optimisation algorithms, classed by categories.

Part 9 : Install TensorFlow 2 GPU support on Ubuntu

2 min read

A step-by-step instructions to install Tensorflow2 with GPU support on Ubuntu

Part 8 : Install TensorFlow 2 GPU using Docker on Ubuntu

5 min read

Installing TensorFlow with GPU support on Ubuntu can be troublesome. We will see how to use Docker avoid a headache.

Part 7 : Non-linear classification with Keras

3 min read

A simple classification example with Keras.

Part 6 : Non-linear classification with Pytorch

3 min read

A simple classification example with Pytorch.

Part 5 : Multi-class classification with neural networks

8 min read

Learn to solve a multi-class classification problem with neural networks in Python.

Part 4 : Non-linear classification with neural networks

4 min read

Let’s see how to deal with non-linear classification problems with artificial neural networks.

Part 3 : Implement a neural network in Python

5 min read

Implement a simple artificial neural network from scratch using only the Numpy library.

Part 2 : The multi-layer perceptron

2 min read

We explain the concept behind the backpropagation algorithm with the multi-layer perceptron

Part 1 : The single-layer perceptron

3 min read

In this post, we will explain how simple artificial neural networks works

Part 9 : Reinforcement learning libraries

2 min read

Let’s compare some reinforcement learning libraries

Part 8.4 : Custom Gym environments for robotics applications

3 min read

I implemented some custom Gym environments for robotics applications with Pybullet and ROS.

Part 8.3 : Getting started with Pybullet

3 min read

An introduction to Pybullet, an open-source physics engine simulator for robotics.

Part 8.2 : Implementing a simple Gym environment - Tic-Tac-Toe

3 min read

Implement the 4 methods for the tic-tac-toe Gym environment.

Part 8.1 : Registering a custom Gym environment

2 min read

Learn to create and register a minimal custom Gym environment.

Part 8 : Implementing custom virtual environments

1 min read

Learn to implement your own training environments with the Gym library.

Part 7 : Deep Q Learning

4 min read

Understand how DQN works and appy it to the Cartpole problem.

Part 6 : Q learning for continuous state problems

6 min read

Adapting Q learning to solve continuous state problems.

Part 5 : Q learning for discrete state problems

8 min read

Q learning is a simple and efficient way to solve discrete state problems.

Part 4 : Introduction to OpenAI Gym

5 min read

Learn to initialise virtual environments for training RL agents with the OpenAI Gym library and implement simple policies.

Part 3 : Reinforcement learning for robotics applications

less than 1 min read

Some interesting research projects that apply reinforcement learning to robotics

Part 2 : Reinforcement learning algorithms taxonomy

3 min read

A list of popular reinforcement learning algorithms grouped by category

Part 1 : What is Reinforcement Learning ?

7 min read

An introduction to the main concepts of reinforcement learning