Designing, building, operationalizing the Customer Profile Database using Google Cloud Platform (GCP) data services such as DataProc, Dataflow, CloudSQL, BigQuery, CloudSpanner in combination with third parties such as Spark, Apache Beam/ composer, DBT, Cloud PubSub, Confluent Kafka, Cloud storage Cloud Functions & Github
Designing and implementing data ingestion patterns that will support batch, streaming and API interface on both the Ingress and Egress.
Working with other Data Engineers & Application Architects in developing framework and custom code using best practices that will meet the demanding performance requirements
Working with minimum supervision in designing and building production data pipelines from data ingestion to consumption using GCP services, Java, Python, Scala, BigQuery, DBT, SQL etc.