Python Archives - Open Data Science - Your News Source for AI, Machine Learning & more

Introduction to IBM Assistant

Python Tools & Languages ibm assistantposted by Divyesh Dharaiya July 16, 2019

IBM Assistant is a chatbot service that many companies are deploying either on their websites or their portal. IBM Watson is providing cloud services, one of them is to build chatbots and you can deploy it either on the website or make a window application. In this blog, our... Read more

Watch: Kubeflow and Beyond: Automation of Model Training, Deployment and Testing

Machine Learning Modeling Pythonposted by ODSC Team July 12, 2019

Very often a workflow of training models and delivering them to the production environment contains loads of manual work. Those could be either building a Docker image and deploying it to the Kubernetes cluster or packing the model to the Python package and installing it to your Python application.... Read more

GPU Dask Arrays, First Steps Throwing Dask and CuPy Together

Modeling Python Tools & Languagesposted by RAPIDS July 4, 2019

The following code creates and manipulates 2 TB of randomly generated data. On a single CPU, this computation takes two hours. On an eight-GPU single-node system this computation takes nineteen seconds. Combine Dask Array with CuPy Actually this computation isn’t that impressive.... Read more

How to Leverage Pre-Trained Layers in Image Classification

Deep Learning Modeling Python leverage pre-trained layersposted by Nathaniel Jermain June 28, 2019

Deep learning models like convolutional neural networks (ConvNet) require large amounts of data to make accurate predictions. In general, sufficient sample size for a ConvNet application would involve tens of thousands of images. Often, only a few thousand labeled images are available for training, validation, and testing. Challenges associated... Read more

Image Augmentation for Convolutional Neural Networks

Machine Learning Modeling Python Convolutional Neural Networks Machine Learning Pythonposted by Nathaniel Jermain June 26, 2019

Limited data is a major obstacle in applying deep learning models like convolutional neural networks. Often, imbalanced classes can be an additional hindrance; while there may be sufficient data for some classes, equally important, but undersampled classes will suffer from poor class-specific accuracy. This phenomenon is intuitive. If the... Read more

Jupyter Notebook: Python or R—Or Both?

Python R Tools & Languages Python Rposted by Steve Miller June 13, 2019

I was analytically betwixt and between a few weeks ago. Most of my Jupyter Notebook work is done in either Python or R. Indeed, I like to self-demonstrate the power of each platform by recoding R work in Python and vice-versa. I must have a dozen active notebooks, some... Read more

Strategies for Addressing Class Imbalance

Machine Learning Modeling Python Machine Learningposted by Nathaniel Jermain June 6, 2019

Class imbalance is common in real-world datasets. For example, a dataset with examples of credit card fraud will often have exponentially more records of non-fraudulent activity than those of fraudulent cases. In many applications, training your model on imbalanced classes can inhibit model functionality if predictive accuracy for minority... Read more

Logistic Regression with Python

Modeling Python Logistic Regression Pythonposted by Ralabs April 11, 2019

Logistic regression was once the most popular machine learning algorithm, but the advent of more accurate algorithms for classification such as support vector machines, random forest, and neural networks has induced some machine learning engineers to view logistic regression as obsolete. Though it may have been overshadowed by more... Read more

Creating Multiple Visualizations in a Single Python Notebook

Data Visualization Modeling Python Tools & Languages Data Visualization Pythonposted by Kailen Santos April 10, 2019

For a data scientist without an eye for design, creating visualizations from scratch might be a difficult task. But as is the case with most problems, a solution awaits thanks to Python. Those drawn to using Python for data analysis have been spoiled, as more advanced libraries have made... Read more

The Anatomy of K-Means Clustering

Modeling Python Tools & Languages Machine Learning Pythonposted by Diego Lopez Yse February 22, 2019

Let’s say you want to classify hundreds (or thousands) of documents based on their content and topics, or you wish to group together different images for some reason. Or what’s even more, let’s think you have that same data already classified but you want to challenge that labeling. You... Read more