The Future of the Single Source of Truth is an Open Data Lake
Editor’s note: Christina is a speaker for ODSC East 2024 this April 23-25. Be sure to check out her talk, “Dive into Data: The Future of the Single Source of Truth is an Open Data Lake,” there! Introduction: The Rise of ELT Organizations that strive for... Read more
Remembering the 2023 Data Engineering Summit in Videos
For the first time ever, the Data Engineering Summit will be in person! Co-located with the leading Data Science and AI Training Conference, ODSC East, this summit will gather the leading minds in Data Engineering in Boston on April 23rd and 24th. We’re currently hard at... Read more
11 Open-Source Data Engineering Tools Every Pro Should Use
Data engineering has become an integral part of the modern tech landscape, driving advancements and efficiencies across industries. At the heart of this revolution are open-source tools, offering powerful capabilities, flexibility, and a thriving community support system. So let’s explore the world of open-source tools for... Read more
What Does a Data Engineering Job Involve in 2024?
Data engineering is a hot topic in the AI industry right now. And as data’s complexity and volume grow, its importance across industries will only become more noticeable. But what exactly do data engineers do? Well, there’s a lot that goes into the job. Not only... Read more
How to Shift from Data Science to Data Engineering
Data engineering is a rapidly growing field, and there is a high demand for skilled data engineers. If you are a data scientist, you may be wondering if you can transition into data engineering. The good news is that there are many skills that data scientists... Read more
10 Data Engineering Topics and Trends You Need to Know in 2024
Now that we’re in 2024, it’s important to remember that data engineering is a critical discipline for any organization that wants to make the most of its data. These data professionals are responsible for building and maintaining the infrastructure that allows organizations to collect, store, process,... Read more
Announcing the 2024 Data Engineering & Ai X Innovation Summits
We couldn’t be more excited to announce two events that will be co-located with ODSC East in Boston this April: The Data Engineering Summit and the Ai X Innovation Summit. These two co-located events represent an opportunity to dive even deeper into the topics and trends... Read more
Zero-ETL, ChatGPT, and the Future of Data Engineering
If you don’t like change, data engineering is not for you. Little in this space has escaped reinvention. The most prominent, recent examples are Snowflake and Databricks disrupting the concept of the database and ushering in the modern data stack era. As part of this movement,... Read more
Data Engineering vs Machine Learning Pipelines
Data engineering and machine learning pipelines are both very different but oddly can feel very similar. Many ML engineers I have talked to in the past rely on tools like Airflow to deploy their batch models. So I wanted to discuss the difference between data engineering... Read more
5 Data Engineering and Data Science Cloud Options for 2023
Data science and data engineering are incredibly resource intensive. Between accessing databases, using frameworks, using applications, and more, a lot of power is needed to run even the simplest algorithms. By using cloud computing, you can easily address a lot of these issues, as many data... Read more