Elevate your career with Tata Consultancy Services as a Senior Databricks Data Engineer. This role emphasizes hands-on experience with Databricks and Spark, focusing on large-scale data architectures in a hybrid work environment.
As a senior engineer, you will lead the modernization of legacy Cloudera platforms to Databricks Lakehouse while implementing enterprise Data Warehouse and Data Lake solutions. Strong skills in finance and risk data models are essential for designing architectures that enhance reporting and analytic capabilities.
Key Responsibilities:
• Transform legacy systems to Databricks Lakehouse architecture
• Redesign data ingestion and transformation processes
• Ensure data integrity and audit compliance during migrations
• Build scalable data pipelines using PySpark and Spark SQL
• Mentor junior engineers and uphold engineering standards
Requirements:
• Experience in Data Warehouse and Data Lake platforms
• Strong knowledge of Databricks,...