Drive data transformation as a Principal Data Engineer at Tata Consultancy Services (TCS). Leverage your expertise in Databricks and Spark to modernize finance and risk data platforms.
TCS is seeking a Principal Data Engineer with strong experience in enterprise Data Warehouses and Data Lakes. This role involves redesigning data architectures, optimizing pipelines using PySpark, and implementing governance frameworks. You will lead initiatives to transition from legacy Cloudera platforms to advanced Databricks Lakehouse solutions.
Key Responsibilities:
• Modernize and redesign legacy Cloudera systems to Databricks
• Create scalable data ingestion and transformation pipelines
• Implement Medallion architecture for effective data layers
• Manage BI, reporting, and analytics semantic layers
• Define key business metrics, dimensions, and KPIs
Requirements:
• Hands-on experience with Databricks and Spark
• Expertise in finance and risk data models
• Proficie...