Gary Yiu Gary Yiu
0
0
Menu

data pipeline

Browsing Tag
8 posts
  • About
Dark Light
  • Data engineering
  • Google Cloud Platform

Automate data collection with GCP Cloud Functions

Gary
March 8, 2024
  • Data engineering
  • Data pipeline
  • Google Cloud Platform

Build a data pipeline with Airflow and GCP

Gary
June 13, 2023
  • Data engineering
  • Data pipeline
  • Google Cloud Platform

Transforming data in BigQuery

Gary
October 9, 2022
  • Data engineering
  • Data pipeline
  • Google Cloud Platform

Running BigQuery DAG in Airflow locally with Docker

Gary
September 2, 2022
  • Data engineering
  • Google Cloud Platform

Using pandas_gbq to import dataframe to BigQuery

Gary
August 30, 2022
  • Data engineering

Setup Cloud Spanner database and exporting it

Gary
March 21, 2022
  • Data engineering

Using Cloud Dataproc with Google Cloud Storage

Gary
March 16, 2022
  • Data engineering

Creating a Cloud Dataflow pipeline

Gary
March 12, 2022