Deep Learning

This is intended to be a living document and will be added to and corrected over time.

Sheffield Data Science and AI Community

The Sheffield Data Science and AI Community connects researchers with an interest inData Science and Artificial Intelligence across the University of Sheffield.

Artificial Intelligence and Machine Learning Training

In addition to training run by the RSE Team on Deep Learning, our colleagues in IT Services offer a range of free training courses which include topics on Machine Learning.

Online Deep Learning Resource

You can find a list of free Deep Learning resources accessible online below. While not comprehensive, it should provide a good introduction to the field.

If you would like to contribute to the list, please get in touch with Twin at t.karmakharm@sheffield.ac.uk

• General Machine Learning & Deep Learning
  • Reading with Practical exercises
    • Online book & Exercises by Michael Nielson
    • Stanford DL tutorial
  • Reading
    • Online book Ian Goofellow et al
    • Yann Lecun’s NYU spring 2017 DL course - Slides & course notes
  • Video
    • Andrew Ng’s Machine Learning Coursera module - Provides excellent foundation on ML techniques
    • Andrew Ng’s Neural Network and Deep Learning Module
  • A list of other ML algorithms to be aware of
• DL network architecture
  • Convolution networks (visual recognition, image classification & image segmentation)
    • Convolution Neural Networks for visual recognition, Stanford Course
  • Recurrent networks (sequences, audio, video & NLP)
    • Deep Learning for Natural Language Processing, Stanford Course
  • Unsupervised pretraining networks
    • Autoencoder
    • Deep Belief Networks
    • Generative Adversarial Networks
• Interactive & Demonstrators
  • Tensorflow playground
  • Stanford ConvnetJS
• Major DL software packages
  • Caffe
  • Caffe2
  • CNTK
  • DIGITS - GUI and scheduler that uses Caffe and Torch backend
  • Keras - Wrapper over Tensorflow, Theano and CNTK
  • MXNet
  • PyTorch
  • Tensorflow
  • Theano
  • Torch
• Datasets
  • MNIST - Handwritten digits dataset
  • Cifar/TinyImages - Small images classfication
  • Imagenet - Image classification
  • COCO - Image classification and object segmentation
  • Kaggle - Various datasets and competitions
• Blog posts on more specific DL/ML topics
  • Colah’s blog
  • Andrej Karpathy’s blog
  • Deep learning on Matlab
• Interesting Applications and news
  • Converting photos to a particular art style
  • Google’s deep dream
  • AlphaGo
  • Nvidia’s AI news portal
• Deep Learning resource aggregate
  • deeplearning.net
• Deep Learning on UoS’s ShARC cluster
  • Neural network online resources blog post by Desmond Ryan