Tools & Languages Archives - Open Data Science - Your News Source for AI, Machine Learning & more

Smoothing Data in SQL

Tools & Languagesposted by Robert de Graaf June 29, 2020

A problem found throughout the world of data is how to distinguish signal from noise. When dealing with data that comes in a sequence, such as time-series data (the most familiar example but by no means the only example), a frequent method of dealing with the problem is to... Read more

An Introduction to AWS Networking – Virtual Private Cloud

Modeling Python Tools & Languages AWSposted by ODSC Community June 22, 2020

Cloud computing is one of the major trends in computing today and has been for many years. Public cloud providers have transformed the start-up industry and what it means to launch a service from scratch. We no longer need to build our own infrastructure; we can pay public cloud... Read more

A Data Pattern with an R data.table Solution.

Modeling R Tools & Languagesposted by Steve Miller April 17, 2020

Summary: This blog examines a loading pattern seen often with government-generated, web-accessible data. The data comprise millions of records across multiple text or csv files, generally demarcated by time. The files may present different, but overlapping, attributes, while much of the data has a character representation, posing the challenge... Read more

Data Manipulation in R

R Tools & Languages data manipulationposted by Antoine Soetewey April 17, 2020

Not all datasets are as clean and tidy as you would expect. Therefore, after importing your dataset into RStudio, most of the time you will need to prepare it before performing any statistical analyses. Data manipulation can even sometimes take longer than the actual analyses when the quality of the... Read more

Creating if/elseif/else Variables in Python/Pandas

Python Tools & Languagesposted by Steve Miller March 27, 2020

Frequencies and Chaining in Python-Pandas

Python Tools & Languages Pandasposted by Steve Miller March 24, 2020

A few years ago, in a Q&A session following a presentation I gave on data analysis (DA) to a group of college recruits for my then consulting company, I was asked to name what I considered the most important analytic technique. Though a surprise to the audience, my answer,... Read more

Creating a Data Analysis Pipeline in Python

Conferences ODSC Speaker Python Tools & Languages East 2020 Snakemakeposted by ODSC Community March 13, 2020

The goal of a data analysis pipeline in Python is to allow you to transform data from one state to another through a set of repeatable, and ideally scalable, steps. Problems for which I have used data analysis pipelines in Python include: Processing financial / stock market data, including... Read more

Guide to R and Python in a Single Jupyter Notebook

Python R Tools & Languages jupyterposted by Matthew Stewart March 6, 2020

Why pick one when you can use both at the same time? R is primarily used for statistical analysis, while Python provides a more general approach to data science. R and Python are object-oriented towards data science for programming language. Learning both is an ideal solution. Python is a... Read more

Complex Queries in SQL

Tools & Languages SQLposted by Robert de Graaf March 5, 2020

Hopefully, your SQL queries aren’t tangled like this. (Photo: Author) Texts on SQL are good at providing the basic templates of SQL syntax, but sometimes the queries in those books are a little idealized compared to real life, with no more than two or three tables to join and... Read more

PI and Simulation Art in R

R Tools & Languages Uncategorizedposted by Steve Miller February 25, 2020

I spent the better part of an afternoon last week perusing a set of old flash drives I’d made years ago for my monthly notebook backups. One that especially caught my attention had a folder of R scripts, probably at least 15 years old — harking back to my... Read more