Blog
Tag: #data-engineering (6)
#all
#airflow
#api
#automation
#bigquery
#cloud
#data-engineering
#gcp
#python
#snowflake
#sql
#system-design
#terraform
-
Airflow Incremental Loading
Big data can be difficult data. Design your Airflow pipelines to process data more efficiently with incremental loading.
-
Airflow Scheduling
Enjoy life and let Airflow handle the boring stuff. We're talking about how you can schedule those tasks to run for you.
-
Accio Database
Let's summon a database by scraping the Potter DB API!
-
Airflow Params
Want to make friends? Design your Airflow DAGs with Params. Your co-workers (or you 6 months from now) will thank you.
-
BigQuery Flavor of SQL
What are some of the unique features of BigQuery's GoogleSQL? Let's dive into some helpful syntax for day-to-day querying.
-
What is Data Engineering? (For Your Mom)
Have you ever had trouble explaining your job as a data engineer? This one's for you, Mom.