Deep Learning

(TBA)

This is an ongoing project and will be updated as soon as I can.

One of the most exciting developments in computer science/machine learning recently has been the new algorithms that made deep learning possible. I have started to explore the potential of deep learning in astronomy, such as in galaxy morphological classification and the large-scale structure of the Universe. The note below is a summary of the standard backward error propagation (backpropagation in short) learning algorithm in vanilla artificial neural network (ANN, left) and convolutional neural network (CNN, middle and right). I will put it down in latex soon.

I have been developing my own code:

https://github.com/guangtunbenzhu/BGT-Cosmology/tree/master/DeepLearning

The vanilla ANN code (ann.py) is fast and robust. The convolutional CNN code (cnn.py) is still work in progress and will be updated soon.

This is a nice tutorial on neural network for beginners,

http://neuralnetworksanddeeplearning.com/

There are also a few well-written packages in deep learning, such as

They have GPU options to speed up the convolution operations drastically.