Embark on a transformative journey as a Senior Software Engineer focused on big data solutions. Apply your skills in Spark, Airflow, and Databricks to drive substantial impact across data workflows.
You will play a pivotal role in addressing intricate data processing problems and ensuring the reliability of data pipelines. Collaborate with various teams to facilitate on-time software releases, enhance data validation techniques, and deliver value through a structured development cycle.
Key Responsibilities:
• Tackle complex data processing challenges
• Partner to ensure timely releases of software
• Strengthen monitoring and validation protocols
• Drive incremental developments and fixes
• Collaborate efficiently across different time zones
Requirements:
• Hands-on expertise in Spark, Airflow, AWS, and Databricks
• Strong programming skills in Python and SQL
• Familiarity with big data processing concepts
• Experience in debugging and testing framewo...