There are many mixed opinions regarding the future of deep learning, and how far it can really go. Gary Marcus’s paper, “Deep Learning: A Critical Appraisal” overviews the social and more technical concerns with deep learning, and examines the possibility of it simply hitting a wall. Having only reached... Read more
Requests for Research
Table of contents: Task-independent data augmentation for NLP Few-shot learning for NLP Transfer learning for NLP Multi-task learning Cross-lingual learning Task-independent architecture improvements It can be hard to find compelling topics to work on and know what questions are interesting to ask when you are just starting as a... Read more
The Six Stages of Computational Science
This is the second in a series of articles related to computational science and education.  The first article is here. The Six Stages of Computational Science When I was in grad school, I collaborated with a research group working on computational fluid dynamics.  They had accumulated a large, complex code... Read more
Let’s start with machine learning In short, machine learning algorithms are algorithms that learn (often predictive) models from data. I.e., instead of formulating “rules” manually, a machine learning algorithm will learn the model for you. So, let me give you an example to illustrate what that means! Say you... Read more
Named Entity Recognition: Milestone Models, Papers and Technologies
Named Entity Recognition: Extracting named entities from text Named Entity Recognition (NER), or entity extraction is an NLP technique which locates and classifies the named entities present in the text. Named Entity Recognition classifies the named entities into pre-defined categories such as the names of persons, organizations, locations, quantities, monetary... Read more
Beyond Computational Reproducibility, let us Aim for Reusability
Scientific progress calls for reproducing results. Due to limited resources, this is difficult even in computational sciences. Yet, reproducibility is only a means to an end. It is not enough by itself to enable new scientific results. Rather, new discoveries must build on reuse and modification of the state... Read more
Web Scraping Indeed for Key Data Science Job Skills
Editor’s Note: Check out our 2017 State of Data Science Jobs Report to compare stats, sentiments, and POVs. *available in Spanish   As many of you probably know, being a data scientist requires a large skill set . . . Read more
The software engineering rule of 3
Here’s a dumb extremely accurate rule I’m postulating* for software engineering projects: you need at least 3 examples before you solve the right problem. This is what I’ve noticed: Don’t factor out shared code between two classes. Wait until you have at least three. The two first attempts to solve a problem... Read more
Our research in 2016: personal scientific highlights
Year 2016 has been productive for science in my team. Here are some personal highlights: bridging artificial intelligence tools to human cognition, markers of neuropsychiatric conditions from brain activity at rest, algorithmic speedups for matrix factorization on huge datasets… Artificial-intelligence convolutional networks map well the human visual system Eickenberg et... Read more
Introduction Link to Part 1 Link to Part 2 In this post, we’ll go into summarizing a lot of the new and important developments in the field of computer vision and convolutional neural networks. We’ll look at some of the most important papers that have been published over the... Read more