GCP Cloud Track

This track covers the core data pipeline flows that are part of a typical GCP Data Engineer role.

Pipelines in this track

  • RDBMS → Dataflow (Flex Template) → BigQuery (Batch Ingestion)
    RDBMS → Dataflow (Flex Template) → BigQuery (Batch Ingestion)
  • SFTP → Composer (Airflow) → GCS → BigQuery
    SFTP → Composer (Airflow) → GCS → BigQuery
  • BigQuery Stored Procedures → ELT & SCD
    BigQuery Stored Procedures → ELT & SCD
  • BigQuery + dbt (Modular ELT)
    BigQuery + dbt (Modular ELT)
  • BigQuery → CSV Export → Vendor Delivery (Reverse ETL)
    BigQuery → CSV Export → Vendor Delivery (Reverse ETL)
  • BigQuery ML → Train & Predict
    BigQuery ML → Train & Predict