Modern Data Engineering
Subscribe
Sign in
Home
👨💻 Projects
❔ About
🏆 Leaderboard
📚 All Posts
📓 Free DE Resources
Latest
Top
Discussions
Configuration Data Formats in Data Engineering
Configuration files control how things behave, where data may go, and what transformations occur. Yet, the choice of format for these files is often not…
Aug 20
•
Elias Benaddou Idrissi
12
Share this post
Configuration Data Formats in Data Engineering
moderndataengineering.substack.com
Copy link
Facebook
Email
Note
Other
1
Logging For Data Engineers
Logging will no longer be an afterthought
Aug 9
•
Elias Benaddou Idrissi
8
Share this post
Logging For Data Engineers
moderndataengineering.substack.com
Copy link
Facebook
Email
Note
Other
April 2024
Unit Testing in Data Engineering
A few things about unit testing with pytest
Apr 21
•
Elias Benaddou Idrissi
7
Share this post
Unit Testing in Data Engineering
moderndataengineering.substack.com
Copy link
Facebook
Email
Note
Other
2
Event-Driven Data Pipelines in AWS - Part 2
An introduction to building AWS infrastructure with Terraform
Apr 6
•
Elias Benaddou Idrissi
3
Share this post
Event-Driven Data Pipelines in AWS - Part 2
moderndataengineering.substack.com
Copy link
Facebook
Email
Note
Other
March 2024
Event-Driven Data Pipelines in AWS - Part 1
Data engineers should always be architecting
Mar 25
•
Elias Benaddou Idrissi
4
Share this post
Event-Driven Data Pipelines in AWS - Part 1
moderndataengineering.substack.com
Copy link
Facebook
Email
Note
Other
1
An Introduction To Data Quality Checks For Data Engineers
Attempting to merge data engineers with data quality...TypeError: unsupported operand type(s) for +: 'data engineer' and 'data quality'
Mar 2
•
Elias Benaddou Idrissi
7
Share this post
An Introduction To Data Quality Checks For Data Engineers
moderndataengineering.substack.com
Copy link
Facebook
Email
Note
Other
January 2024
Five Underrated Python Packages For Improving Your Development Experience
For ultimate productivity and the cool factor
Jan 15
•
Elias Benaddou Idrissi
6
Share this post
Five Underrated Python Packages For Improving Your Development Experience
moderndataengineering.substack.com
Copy link
Facebook
Email
Note
Other
November 2023
Introduction to Concurrency in Python for Data Engineers
Multithreading vs Asynchronous vs Multiprocessing
Nov 12, 2023
•
Elias Benaddou Idrissi
13
Share this post
Introduction to Concurrency in Python for Data Engineers
moderndataengineering.substack.com
Copy link
Facebook
Email
Note
Other
1
July 2023
First Impressions of Mage
Will Mage replace Airflow?
Jul 1, 2023
•
Elias Benaddou Idrissi
8
Share this post
First Impressions of Mage
moderndataengineering.substack.com
Copy link
Facebook
Email
Note
Other
2
May 2023
Breaking into Data Engineering as a Self-Taught Developer
From data analyst to data engineer: why I made the transition
May 30, 2023
•
Elias Benaddou Idrissi
8
Share this post
Breaking into Data Engineering as a Self-Taught Developer
moderndataengineering.substack.com
Copy link
Facebook
Email
Note
Other
1
Git Explained - Unstage, Unmodify & Undo
Undoing mistakes in git doesn't have to be a headache. With a little know-how, you can learn the ins and outs of each command and save yourself time and…
May 1, 2023
•
Elias Benaddou Idrissi
4
Share this post
Git Explained - Unstage, Unmodify & Undo
moderndataengineering.substack.com
Copy link
Facebook
Email
Note
Other
April 2023
Data Engineering Design Principles You Should Follow
Design principles to follow that will take your data engineering skills to the next level.
Apr 22, 2023
•
Elias Benaddou Idrissi
5
Share this post
Data Engineering Design Principles You Should Follow
moderndataengineering.substack.com
Copy link
Facebook
Email
Note
Other
Share
Copy link
Facebook
Email
Note
Other
This site requires JavaScript to run correctly. Please
turn on JavaScript
or unblock scripts