Choosing the right activation function in a neural network Activation functions are one of the many parameters you must choose to gain optimal success and performance with your neural network. In this article I’m going to assume you understand the basics of how a neural network works, and will... Read more
Editor’s note: ODSC supports the self-education of data enthusiasts of all levels, building the access to information and the means to showcase their data driven passions. The author of this post is a premier example of one such intersection. Caspar is our youngest Data Science Associate yet, and you... Read more
An Overview of Multi-Task Learning in Deep Neural Networks
Note: If you are looking for a review paper, this blog post is also available as an article on arXiv. Table of contents: Introduction Motivation Two MTL methods for Deep Learning Hard parameter sharing Soft parameter sharing Why does MTL work? Implicit data augmentation Attention focusing Eavesdropping Representation bias Regularization... Read more
Open Data Science - Your News Source for AI, Machine Learning & more