Tools & Languages Archives - Open Data Science - Your News Source for AI, Machine Learning & more

Getting Started with Pandas

Modeling Python Tools & Languages Pandas West 2020posted by ODSC Community September 16, 2020

Pandas is a popular data analysis library built on top of the Python programming language, and getting started with Pandas is an easy task. It assists with common manipulations for data cleaning, joining, sorting, filtering, deduping, and more. First released in 2009, pandas now sits as... Read more

Removing Items From a Set – remove(), pop(), and difference

Modeling Python Tools & Languagesposted by ODSC Community September 10, 2020

Python has a rich collection of built-in data structures. These data structures are sometimes called “containers” or “collections” because they contain a collection of individual items. These structures cover a wide variety of common programming situations. In this recipe, we’ll look at how we can update a set by... Read more

Retrieving Webpages Through Python Programming

Modeling R Tools & Languages Web Scrapingposted by ODSC Community July 22, 2020

This article discusses retrieving web pages through Python programming. The internet and the World Wide Web (WWW), is probably the most prominent source of information today. Most of that information is retrievable through HTTP. HTTP was invented originally to share pages of hypertext (hence th.e name Hypertext Transfer Protocol),... Read more

Using a Smoother in SQL

Tools & Languagesposted by Robert de Graaf June 29, 2020

A problem found throughout the world of data is how to distinguish signal from noise. When dealing with data that comes in a sequence, such as time-series data (the most familiar example but by no means the only example), a frequent method of dealing with the... Read more

An Introduction to AWS Networking – Virtual Private Cloud

Modeling Python Tools & Languages AWSposted by ODSC Community June 22, 2020

Cloud computing is one of the major trends in computing today and has been for many years. Public cloud providers have transformed the start-up industry and what it means to launch a service from scratch. We no longer need to build our own infrastructure; we can... Read more

A Data Pattern with an R data.table Solution.

Modeling R Tools & Languagesposted by Steve Miller April 17, 2020

Summary: This blog examines a loading pattern seen often with government-generated, web-accessible data. The data comprise millions of records across multiple text or csv files, generally demarcated by time. The files may present different, but overlapping, attributes, while much of the data has a character representation,... Read more

Data Manipulation in R

R Tools & Languages data manipulationposted by Antoine Soetewey April 17, 2020

Not all datasets are as clean and tidy as you would expect. Therefore, after importing your dataset into RStudio, most of the time you will need to prepare it before performing any statistical analyses. Data manipulation can even sometimes take longer than the actual analyses when the... Read more

Creating if/elseif/else Variables in Python/Pandas

Python Tools & Languagesposted by Steve Miller March 27, 2020

Frequencies and Chaining in Python-Pandas

Python Tools & Languages Pandasposted by Steve Miller March 24, 2020

A few years ago, in a Q&A session following a presentation I gave on data analysis (DA) to a group of college recruits for my then consulting company, I was asked to name what I considered the most important analytic technique. Though a surprise to the... Read more

Creating a Data Analysis Pipeline in Python

Conferences ODSC Speaker Python Tools & Languages East 2020 Snakemakeposted by ODSC Community March 13, 2020

The goal of a data analysis pipeline in Python is to allow you to transform data from one state to another through a set of repeatable, and ideally scalable, steps. Problems for which I have used data analysis pipelines in Python include: Processing financial / stock... Read more