This was originally posted on the Silicon Valley Data Science blog. How can artificial neural nets help in understanding our brain’s neural net? On the weekend of March 24–26, YCombinator-backed startup DeepGram hosted a deep learning hackathon. The weekend-long event included speakers and judges from Google Brain, NVIDIA, and Baidu. My colleague,... Read more
Applying Deep Learning to natural language processing
Language is the medium that humans use for conversing. Giving machines the ability to learn human language with natural language processing has given rise to several new products and possibilities that were not previously imaginable. Natural language processing (NLP) is one of the most important technologies present in the... Read more
In this notebook, I will explain how to implement a neural network from scratch and use the version of MNIST dataset that is provided within Scikit-Learn for testing. I will specificallty illustrate the use of Python classes to define layers in the network as objects. Each layer object has... Read more
Learning in Brains and Machines (3): Synergistic and Modular Action
There is a dance—precisely choreographed and executed—that we perform throughout our lives. This is the dance formed by our movements. Our movements are our actions and the final outcome of our decision making processes. Single actions are built into reusable sequences, sequences are composed into complex routines, routines are arranged into elegant choreographies, and so the complexity of human action is realised.... Read more
Intro. How I Plan to Teach Myself Deep Learning Using Only Free Resources Learning Deep Learning Series Part 1: Videos Learning Deep Learning Part 2: Online Courses Learning Deep Learning Part 3: Github Repos This is the second in a series of articles in which Data Science Associate George... Read more
Hype or Not? Some Perspective on OpenAI’s DotA 2 Bot
See the Hacker News Discussion for additional context. Update (August 17th, 2017): OpenAI has published a blog post with more details about the bot. Almost everything of the post below still holds true, however. OpenAI’s post is sparse on technical details as they “not ready to talk about agent... Read more
How I Used Deep Learning To Train A Chatbot To Talk Like Me (Sorta)
Introduction Chatbots are “computer programs which conduct conversation through auditory or textual methods”. Apple’s Siri, Microsoft’s Cortana, Google Assistant, and Amazon’s Alexa are four of the most popular conversational agents today. They can help you get directions, check the scores of sports games, call people in your address book, and can accidently make you order... Read more
How to make a racist AI without really trying
A cautionary tutorial. Perhaps you heard about Tay, Microsoft’s experimental Twitter chat-bot, and how within a day it became so offensive that Microsoft had to shut it down and never speak of it again. And you assumed that you would never make such a thing, because you’re not doing... Read more
The functioning of our brains, much like the intrigue of a political drama, is a neuronal house-of-cards. The halls of cognitive power are run by recurring alliances of neurons that deliberately conspire to control information processing and decision making. ‘Suspicious coincidences’ in neural activation—as the celebrated neuroscientist Horace Barlow observed—are abound; transparency in neural... Read more
Deep Learning for NLP Best Practices
Table of contents: Introduction Best practices Word embeddings Depth Layer connections Dropout Multi-task learning Attention Optimization Ensembling Hyperparameter optimization LSTM tricks Task-specific best practices Classification Sequence labelling Natural language generation Neural machine translation Introduction This post is a collection of best practices for using neural networks in Natural Language... Read more