- How To Create A Mind By Ray Kurzweil
 
- Deep Learning, Self-Taught Learning and Unsupervised Feature Learning By Andrew Ng
 
- Recent Developments in Deep Learning By Geoff Hinton
 
- The Unreasonable Effectiveness of Deep Learning by Yann LeCun
 
- Deep Learning of Representations by Yoshua bengio
 
- Principles of Hierarchical Temporal Memory by Jeff Hawkins
 
- Machine Learning Discussion Group - Deep Learning w/ Stanford AI Lab by Adam Coates
 
- Making Sense of the World with Deep Learning By Adam Coates
 
- Demystifying Unsupervised Feature Learning  By Adam Coates
 
- Visual Perception with Deep Learning By Yann LeCun
 
- The Next Generation of Neural Networks By Geoffrey Hinton at GoogleTechTalks
 
- The wonderful and terrifying implications of computers that can learn By Jeremy Howard at TEDxBrussels
 
- Unsupervised Deep Learning - Stanford by Andrew Ng in Stanford (2011)
 
- Natural Language Processing By Chris Manning in Stanford
 
- A beginners Guide to Deep Neural Networks By Natalie Hammel and Lorraine Yurshansky
 
- Deep Learning: Intelligence from Big Data by Steve Jurvetson (and panel) at VLAB in Stanford.
 
- Introduction to Artificial Neural Networks and Deep Learning by Leo Isikdogan at Motorola Mobility HQ
 
- NIPS 2016 lecture and workshop videos - NIPS 2016
 
- Deep Learning Crash Course: a series of mini-lectures by Leo Isikdogan on YouTube (2018)
 
Deep Learning with R in Motion: a live video course that teaches how to apply deep learning to text and images using the powerful Keras library and its R language interface.
Papers
You can also find the most cited deep learning papers from here
 
ImageNet Classification with Deep Convolutional Neural Networks
 
Using Very Deep Autoencoders for Content Based Image Retrieval
 
Learning Deep Architectures for AI
 
CMU’s list of papers
 
Neural Networks for Named Entity Recognition zip
 
Training tricks by YB
 
Geoff Hinton's reading list (all papers)
 
Supervised Sequence Labelling with Recurrent Neural Networks
 
Statistical Language Models based on Neural Networks
 
Training Recurrent Neural Networks
 
Recursive Deep Learning for Natural Language Processing and Computer Vision
 
Bi-directional RNN
 
LSTM
 
GRU - Gated Recurrent Unit
 
GFRNN . .
 
LSTM: A Search Space Odyssey
 
A Critical Review of Recurrent Neural Networks for Sequence Learning
 
Visualizing and Understanding Recurrent Networks
 
Wojciech Zaremba, Ilya Sutskever, An Empirical Exploration of Recurrent Network Architectures
 
Recurrent Neural Network based Language Model
 
Extensions of Recurrent Neural Network Language Model
 
Recurrent Neural Network based Language Modeling in Meeting Recognition
 
Deep Neural Networks for Acoustic Modeling in Speech Recognition
 
Speech Recognition with Deep Recurrent Neural Networks
 
Reinforcement Learning Neural Turing Machines
 
Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation
 
Google - Sequence to Sequence  Learning with Neural Networks
 
Memory Networks
 
Policy Learning with Continuous Memory States for Partially Observed Robotic Control
 
Microsoft - Jointly Modeling Embedding and Translation to Bridge Video and Language
 
Neural Turing Machines
 
Ask Me Anything: Dynamic Memory Networks for Natural Language Processing
 
Mastering the Game of Go with Deep Neural Networks and Tree Search
 
Batch Normalization
 
Residual Learning
 
Image-to-Image Translation with Conditional Adversarial Networks
 
Berkeley AI Research (BAIR) Laboratory
 
MobileNets by Google
 
Cross Audio-Visual Recognition in the Wild Using Deep Learning
 
Dynamic Routing Between Capsules
 
Matrix Capsules With Em Routing
 
Efficient BackProp
 
Have anything in mind that you think is awesome and would fit in this list? Feel free to send a pull request.