Factorization Machin...
As a Data Scientist that works on Feed Personalization, I find it it important to stay up to date with the current state of Machine Learning and its applications. Most of the time, using some of the better-known recommendation algorithms yields good initial results; however, sometimes a change in the model is essential to provide customers […]
Handwritten digits r...
The progress in technology that has happened over the last 10 years is unbelievable. Every corner of the world is using the top most technologies to improve existing products while also conducting immense research into inventing products that make the world the best place to live. Some of these are the Amazon just walk out […]
How NOT to program t...
Using TensorFlow from Python is like using Python to program another computer. Some Python statements build your TensorFlow program, some Python statements execute that program, and of course some Python statements aren’t involved with TensorFlow at all. Being thoughtful about the graphs you construct can help you avoid confusion and performance pitfalls. Here are a […]
TensorFlow and Queue...
There are many ways to implement queue data structures, and TensorFlow has some of its own. FIFO Queue with a list In Python, a list can implement a first-in first-out (FIFO) queue, with slightly awkward syntax: >>> my_list = [] >>> my_list.insert(0, 'a') >>> my_list.insert(0, 'b') >>> my_list.insert(0, 'c') >>> my_list.pop() 'a' >>> my_list.pop() 'b' […]
Use only what you ne...
There isn’t just one decision to use TensorFlow or not use TensorFlow; you have to make decisions about which pieces of TensorFlow you’re going to use. I’ve thought about whether Tensorflow suffers from the second-system effect, and my conclusion is that while TensorFlow has a huge abundance of features, it can’t really be said to […]
Experiment with Dask...
This post briefly describes potential interactions between Dask and TensorFlow and then goes through a concrete example using them together for distributed training with a moderately complex architecture. This post was written in haste, see disclaimers below. This work was originally at matthewrocklin.com and is supported by Continuum Analytics and the XDATA Program as part of the […]
Image Processing in ...
This was originally posted on the Silicon Valley Data Science blog. The first step in developing our Caltrain project was creating a proof of concept for the image processing component of the device we used to detect passing trains. We’re big fans of Jupyter Notebooks at SVDS, and so we’ve created a notebook to walk […]
Introduction to Trai...
This was originally posted on the Silicon Valley Data Science blog. At Silicon Valley Data Science, we have a slight obsession with the Caltrain. Our interest stems from the fact that half of our employees rely on the Caltrain to get to work each day. We also want to give back to the community, and […]
Implementing a CNN f...
The full code is available on Github. In this post we will implement a model similar to Kim Yoon’s Convolutional Neural Networks for Sentence Classification. The model presented in the paper achieves good classification performance across a range of text classification tasks (like Sentiment Analysis) and has since become a standard baseline for new text […]
