Lead innovative data engineering initiatives as a Manager at our company. This hybrid role emphasizes developing scalable cloud-native data platforms while working in investment management workflows.
We seek a skilled Manager, Data Engineer to design, optimize, and maintain cloud-native data platforms. Your expertise in modern big data technologies and distributed data processing will be essential in delivering robust solutions. Collaborate closely with various teams to ensure seamless integration and high performance in data operations.
Key Responsibilities:
• Develop and optimize Spark workloads in cloud environments
• Design scalable data pipelines using Python and PySpark
• Work with large datasets in Parquet and Iceberg formats
• Translate requirements into engineering solutions with stakeholders
• Ensure maintainability of data platforms through best practices
Requirements:
• Strong experience with Python, PySpark, and Apache Spark
• Hands-on experie...