Generating Aesop's Fables One Character at a Time...

Note: The supporting code for this blog post can be found on GitHub. I must admit, I'm a fan of Aesop's Fables. These are a collection of fables credited to Aesop, a slave and storyteller believed…


Fisher Iris Dataset Classification with Torch

Note: The code supporting this post can be found on GitHub. For people interested in deep learning, there's never been a better selection of open-source frameworks available. I recently took some…


Baidu Open-Sources AI Secrets

Baidu (the Chinese Google) has just released its WARP-CTC library on GitHub under an open-source Apache licence. CTC is an objective function that can be used for the supervised training of sequence…


From Neural Networks to Deep Learning

A few years ago, I began blogging about Neural Networks. I have had an interest in this side of machine learning for more time than I can remember. However, even though these amazingly useful…


Self Organising Map C#

In this post, I shall be discussing Self Organising Maps (SOM), which are also known as Kohonen maps or topographical maps. Until now, all of my posts have focussed on supervised learning, i.e. we…


Back Propagation Multi-Output Neural Network C#

In this post, I publish an updated version of my multi-layer Perceptron - new features and improvements include: A graphical representation of network activity The ability to handle multiple network…


Train Neural Networks with Back Propagation C#

In my previous post, I showed how multi layer Perceptrons could be used to solve linearly non-separable problems. In that example, I calculated all the network weights by hand. In this post, I shall…


Hidden Neurons and Feature Space

In this post, I continue on the journey to solve linearly non-separable problems using the Multi Layer Perceptron. I will be using the same problem that I introduced last week. The network I will be…


The Sigmoid Function C#

In my last post, I discussed the Single Layer Perceptron and its limitations regarding solving linearly non-separable problems. If we are to solve this type of problem, then we need a more…


The Single Layer Perceptron C#

This is the first in a series of posts in which I will write about the evolution of neural networks. I will start with the most simple network of all, the Single Layer Perceptron, and work through…