NLP with NLTK – Part 2

NLP with NLTK –...

Hello all and welcome to the second of the series – NLP with NLTK. The first of the series can be found here, incase you have missed. In this article we will talk about basic NLP concepts and use NLTK to implement the concepts. Contents: Corpus Tokenization/Segmentation Frequency Distribution Conditional Frequency Distribution Normalization Zipf’s law […]

ConceptNet 5.5 and conceptnet.io

ConceptNet 5.5 and c...

ConceptNet is a large, multilingual knowledge graph about what words mean. This is background knowledge that’s very important in NLP and machine learning, and it remains relevant in a time when the typical thing to do is to shove a terabyte or so of text through a neural net. We’ve shown that ConceptNet provides information […]

On Building a “Fake News” Classification Model *update

On Building a “...

“A lie gets halfway around the world before the truth has a chance to get its pants on.” – Winston Churchill Since the 2016 presidential election, one topic dominating political discourse is the issue of “Fake News”. A number of political pundits claim that the rise of  significantly biased and/or untrue news influenced the election, though a study by researchers […]

How Twitter Reacted to the Academy Awards and Its Crazy Ending

How Twitter Reacted ...

Award show night-Twitter is a special genre of tweeting. It’s a several-hour long affair where Twitter users perform just as much for their followers as the award recipients. It’s a cutthroat competition to beat your fellow tweeters to the funniest jokes and best takes for every moment of the night. To some, the tweets are the event’s main draw and […]

NLP with NLTK – Part 1

NLP with NLTK –...

Introduction: The idea of using a structured programming language to interact with computers is being challenged by Natural Language Processing (NLP) and Natural Language Understanding methods. NLP holds great promises of making computer interfaces accessible to a wide range of audiences – as humans would be able to talk to computers in their own native […]

Here’s What Twitter Was Like During the Super Bowl.

Here’s What Tw...

The Patriots 34-28 win in Super Bowl 51 was, quite possibly, one of greatest football games of all time. It had the largest Super Bowl comeback of all time and was the first to ever to go to overtime. For data-minded folks, the game exhibited striking parallels to the election. ESPN’s live prediction models was saying that Atlanta was almost certain to […]

Resolution Tweet Breakdown

Resolution Tweet Bre...

It’s a new year everyone, which means new years resolutions. Many us are making the usual promises to ourselves about picking up or dropping certain habits. Thinking about new year’s resolutions prompted us here at opendatascience.com to think about and analyze people’s goals. While it’s impossible to know everyone’s resolution, the next best thing is what we can collect from […]

Implementing a CNN for Text Classification in Tensorflow

Implementing a CNN f...

The full code is available on Github. In this post we will implement a model similar to Kim Yoon’s Convolutional Neural Networks for Sentence Classification. The model presented in the paper achieves good classification performance across a range of text classification tasks (like Sentiment Analysis) and has since become a standard baseline for new text […]

Debate Night Twitter Part 2: Analyzing the Tweets of the Final Debate.

Debate Night Twitter...

Editor’s note: Opinions expressed in this post do not necessarily reflect the views of #ODSC Last Wednesday, the third and final debate of the 2016 Presidential Election was held and with three weeks to go before election day, the two candidates sought to persuade undecided voters and rally their supporters in another tense head-t0-head matchup. As we did for the […]