Join a dynamic team to spearhead the migration from Glue/Redshift to Databricks as a Lead Data Engineer. This role emphasizes Apache Spark expertise and cloud data services knowledge.
We are seeking a Data Engineer with over ten years of experience, including two years in a tech lead role. You must have significant hands-on experience with Apache Spark, Databricks, and AWS data services. Your contribution will focus on migrating substantial data platforms, ensuring a seamless transition while leading a skilled team.
Key Responsibilities:
• Lead migration efforts from Glue/Redshift to Databricks
• Optimize performance using Apache Spark techniques
• Enhance production processes with Databricks features
• Supervise AWS services integration and performance
• Develop clear design documents and migration strategies
Requirements:
• 10+ years of data engineering experience
• At least 2 years in a tech lead position
• Deep expertise in Apache Spark and Databric...