Shape data engineering at your best with a lead role focused on migrating to Databricks. Capitalize on your extensive experience with AWS services and Apache Spark for impactful data solutions.
This Lead Data Engineer position requires 10+ years of experience, with a strong 2+ years as a tech lead. You'll drive the migration from Glue and Redshift to Databricks, leveraging your expertise in Apache Spark and leading teams through substantial platform transitions.
Key Responsibilities: • Lead migration efforts from Glue/Redshift to Databricks • Optimize Apache Spark performance through tuning techniques • Manage production workflows using Databricks and Delta Lake • Direct substantial data platform migrations end-to-end • Communicate effectively with technical and executive teams
Requirements: • 10+ years in data engineering, 2+ years in a lead role • Deep hands-on experience with AWS Glue and Redshift ...