Why are Convnets Often Better Than the Rest? Part I
Deep LearningModelingposted by Caspar Wylie, ODSC June 11, 2018
Introduction In this series, I will explore convolutional neural networks in comparison to standard neural networks. To begin with, the former is an evolution of the latter. Through analyzing this evolution, it is fascinating to see how particular design differences have such a great impact on performance and overall... Read more
Reel Reviews: Neural Networks for Sentiment Analysis
Deep LearningModelingposted by Win Suen June 5, 2018
This is a joint article authored in collaboration between Kannan Sankaran and Win Suen. The Problem Over the past few years, there has been burgeoning interest in neural networks from data science and engineering communities. The advent of ever larger datasets, efficient commodity hardware, and powerful open source libraries... Read more
The History of Neural Networks and AI: Part III
Deep LearningModelingposted by Caspar Wylie, ODSC June 4, 2018
This article is the third and final article in a three-part series about the history of neural networks and artificial intelligence. To view the first article that dives into the earliest developments of artificial intelligence, click here. For a better picture of how neural networks and artificial intelligence technologies... Read more
The History of Neural Networks and AI: Part 2
Deep LearningModelingposted by Caspar Wylie, ODSC May 23, 2018
This article is the second article in a three-part series about the history of neural networks and artificial intelligence. To view the first article, click here. After the beginning era of AI, a British researcher specializing in artificial intelligence, Donald Michie, designed a machine made from matchboxes in 1963... Read more
An Overview of Proxy-label Approaches for Semi-supervised Learning
Deep LearningModelingposted by Sebastian Ruder May 18, 2018
Note: Parts of this post are based on my ACL 2018 paper Strong Baselines for Neural Semi-supervised Learning under Domain Shift with Barbara Plank. Table of contents: Self-training Multi-view training Co-training Democratic Co-learning Tri-training Tri-training with disagreement Asymmetric tri-training Multi-task tri-training Self-ensembling Ladder networks Virtual Adversarial Training ΠΠ model Temporal Ensembling Mean Teacher... Read more
Datasets Are Books, Not Houses
Deep LearningModelingStatisticsposted by Brendan O'Brien May 2, 2018
What’s content addressing? What does it have to do with datasets? Why am I on this site in the first place? Read on, dear reader. Read on. The world of linked data is built on shaky foundations that prevent a true data commons from emerging. The problem isn’t with... Read more
The History of Neural Networks and AI: Part I
Deep LearningModelingposted by Caspar Wylie, ODSC April 24, 2018
Although machine learning has only become mainstream in the last decade, there are many essential contributors to the field dating back as far as the 1940s. In order to understand the infinite possibilities presented today in the fields of AI, deep learning and more, it is important to understand... Read more
Understanding Neural Network Bias Values
Deep LearningModelingPredictive Analyticsposted by Caspar Wylie, ODSC April 18, 2018
In my other articles, I have discussed the many different neural network hyper parameters that contribute to optimal success. While hyper parameters are crucial for training successful algorithms, the importance of neural network bias values are not to be forgotten as well. In this article I’ll delve into the... Read more
An Infinite Parade of Giraffes: Collaborative Cartooning with AI
Deep LearningModelingposted by K. Gretchen Greene March 29, 2018
What is recognizable about a particular artist’s style? What parts can be delegated to an assistant? Can AI play the role of assistant or even collaborator? How would we ever get enough data for training? How little data could we get away with? Exploring these questions using GANs, image... Read more
Pervasive Simulator Misuse with Reinforcement Learning
Deep LearningModelingMachine Learningposted by John Langford March 28, 2018
The surge of interest in reinforcement learning is great fun, but I often see confused choices in applying RL algorithms to solve problems. There are two purposes for which you might use a world simulator in reinforcement learning: Reinforcement Learning Research: You might be interested in creating reinforcement learning algorithms for... Read more
