Modern Data Engineering

Home
👨‍💻 Projects
❔ About
🏆 Leaderboard
📚 All Posts
📓 Free DE Resources

Configuration Data Formats in Data Engineering

Configuration files control how things behave, where data may go, and what transformations occur. Yet, the choice of format for these files is often not fully thought through.
READ THE LATEST
Most Popular
View all
Learning Data Engineering in 2023
 • Elias Benaddou Idrissi
Breaking into Data Engineering as a Self-Taught Developer
 • Elias Benaddou Idrissi
1
Introduction to Concurrency in Python for Data Engineers
 • Elias Benaddou Idrissi
1
Installing Apache Airflow on AWS EC2
 • Elias Benaddou Idrissi
1
Logging For Data Engineers
Logging will no longer be an afterthought
 • 
Elias Benaddou Idrissi
Unit Testing in Data Engineering
A few things about unit testing with pytest
 • 
Elias Benaddou Idrissi
2
Event-Driven Data Pipelines in AWS - Part 2
An introduction to building AWS infrastructure with Terraform
 • 
Elias Benaddou Idrissi
Event-Driven Data Pipelines in AWS - Part 1
Data engineers should always be architecting
 • 
Elias Benaddou Idrissi
1
An Introduction To Data Quality Checks For Data Engineers
Attempting to merge data engineers with data quality...TypeError: unsupported operand type(s) for +: 'data engineer' and 'data quality'
 • 
Elias Benaddou Idrissi
Five Underrated Python Packages For Improving Your Development Experience
For ultimate productivity and the cool factor
 • 
Elias Benaddou Idrissi
Introduction to Concurrency in Python for Data Engineers
Multithreading vs Asynchronous vs Multiprocessing
 • 
Elias Benaddou Idrissi
1
First Impressions of Mage
Will Mage replace Airflow?
 • 
Elias Benaddou Idrissi
2
Breaking into Data Engineering as a Self-Taught Developer
From data analyst to data engineer: why I made the transition
 • 
Elias Benaddou Idrissi
1
Modern Data Engineering
Modern Data Engineering
Getting into data engineering can be both challenging and rewarding. Accelerate your skills and career with regular posts on becoming a Modern Data Engineer.
Recommendations
View all 14
The T-Shaped Dev
The T-Shaped Dev
Petar Ivanov
The Orchestra Data Leadership Newsletter
The Orchestra Data Leadership Newsletter
Hugo Lu
SeattleDataGuy’s Newsletter
SeattleDataGuy’s Newsletter
SeattleDataGuy
Data Engineer Things
Data Engineer Things
Xinran Waibel
Data Gibberish
Data Gibberish
Yordan Ivanov

Modern Data Engineering

AboutArchiveRecommendationsSitemap
© 2024 Elias Benaddou Idrissi
Privacy ∙ Terms ∙ Collection notice
Start WritingGet the app
Substack is the home for great culture