Attention and Memory in Deep Learning and NLP

Attention and Memory...

A recent trend in Deep Learning are Attention Mechanisms. In an interview, Ilya Sutskever, now the research director of OpenAI, mentioned that Attention Mechanisms are one of the most exciting advancements, and that they are here to stay. That sounds exciting. But what are Attention Mechanisms? Attention Mechanisms in Neural Networks are (very) loosely based […]

An Introduction to Natural Language Processing

An Introduction to N...

In this lecture, we will focus on text based machine learning techniques and learn how to make use of these techniques to do text classification and analysis. Natural language processing (NLP) is the study of translation of human language into something a computer can understand and manipulate. The areas of study within NLP are diverse […]

Intro to Natural Language Processing

Intro to Natural Lan...

Table of Contents 0.0 Setup 0.1 Python and Anaconda 0.2 Libraries 0.3 Other 1.0 Background 1.1 What is NLP? 1.2 Why is NLP Important? 1.3 Why is NLP a “hard” problem? 1.4 Glossary 2.0 Sentiment Analysis 2.1 Preparing the Data 2.1.1 Training Data 2.1.2 Test Data 2.2 Building a Classifier 2.3 Classification 3.0 Regular Expressions […]

NLP and Effective Topic Modeling with Spark MLLib

NLP and Effective To...

Abstract: The world communicates in text. Our work lives have us treading waist-deep in email, our hobbies often have blogs, our complaints go to Yelp, and even our personal lives are lived out via tweets, Facebook updates, and texts. There is a massive amount of information that can be heard from text — as long […]

Google SyntaxNet

Google SyntaxNet...

Google’s TensorFlow framework spread like wildfire upon its release. The slew of tutorials and extensions made an already robust ecosystem even more so. Recently, Google released one of their own extensions. It’s called SyntaxNet, a TensorFlow based syntactic parser for Natural Language Understanding. SyntaxNet uses neural networks to model the precise relationships between words in […]

Naive Bayes and Spam Detection

Naive Bayes and Spam...

In natural language processing, text classification techniques are used to assign a class to a given text.  For example, in spam detection, the classifiers decides an email belongs to a spam or non spam (ham) class. Deciding what the topic of a news article is, or whether a movie review is positive or negative, Authorship […]

Dissecting the Presidential Debates with an NLP Scalpel

Dissecting the Presi...

The recent Republican and Democratic debates drew unprecedented amounts of viewers and the usual lot of controversies and soundbites in the media. Each debate deeply impacted future polls, subsequent fundraising, and the composition of the race. In our polarized media landscape, ensuing political analysis always suffer from political bias. Whether you trust MSNBC or Fox […]

The Definitive Guide to Natural Language Processing

The Definitive Guide...

This blog post by Javier Couto (@jahey00000) Data Scientist at Tryolabs, gives you a clear and comprehensive overview of the state of Natural Language Processing, its applications, and main concepts. A great read to understand what NLP is all about and how it is used in our everyday life.