Choosing the right activation function in a neural network Activation functions are one of the many parameters you must choose to gain optimal success and performance with your neural network. In this article I’m going to assume you understand the basics of how a neural network... Read more
An Overview of Multi-Task Learning in Deep Neural Networks
Note: If you are looking for a review paper, this blog post is also available as an article on arXiv. Table of contents: Introduction Motivation Two MTL methods for Deep Learning Hard parameter sharing Soft parameter sharing Why does MTL work? Implicit data augmentation Attention focusing Eavesdropping... Read more