ConceptNet 5.5 and conceptnet.io
Deep LearningModelingtext analyticsposted by Rob Speer March 30, 2017
ConceptNet is a large, multilingual knowledge graph about what words mean. This is background knowledge that’s very important in NLP and machine learning, and it remains relevant in a time when the typical thing to do is to shove a terabyte or so of text through... Read more
HACKER’S GUIDE TO NEURAL NETWORKS, #2
Deep LearningModelingMachine Learning|Neural Networksposted by Andrej Karpathy March 29, 2017
Chapter 2: Machine Learning In the last chapter we were concerned with real-valued circuits that computed possibly complex expressions of their inputs (the forward pass), and also we could compute the gradients of these expressions on the original inputs (backward pass). In this chapter we will... Read more
TensorFlow and Queues
Deep LearningModelingPython|TensorFlowposted by Aaron Schumacher March 29, 2017
There are many ways to implement queue data structures, and TensorFlow has some of its own. FIFO Queue with a list In Python, a list can implement a first-in first-out (FIFO) queue, with slightly awkward syntax: >>> my_list = >>> my_list.insert(0, 'a') >>> my_list.insert(0, 'b')... Read more
Algorithms are Black Boxes, That is Why We Need Explainable AI
Deep LearningModelingTools & LanguagesAI|Algorithmsposted by Mark van Rijmenam March 28, 2017
Artificial Intelligence offers a lot of advantages for organisations by creating better and more efficient organisations, improving customer services with conversational AI and reducing a wide variety of risks in different industries. Although we are only at the beginning of the AI revolution that is upon us, we... Read more
Deep Learning, IoT Sensor Data…and Bats!
Deep LearningModelingDeep Learning|IoTposted by Sean Lorenz March 28, 2017
At the very center of Internet of Things excitement is the sensor. Not just one sensor, mind you, but a sensor that normally would just be sending a data stream to who knows where would now have access to the information from another sensor measuring something... Read more
Attention and Memory in Deep Learning and NLP
Deep LearningModelingNLP/Text Analyticsposted by Denny Britz December 27, 2016
A recent trend in Deep Learning are Attention Mechanisms. In an interview, Ilya Sutskever, now the research director of OpenAI, mentioned that Attention Mechanisms are one of the most exciting advancements, and that they are here to stay. That sounds exciting. But what are Attention Mechanisms?... Read more