Manager Data Engineer

Join Us as a Manager - Data Engineering! Location: Chennai Experience: 10 to 12 years Level: L4 We are looking for a motivated and skilled Data Engineering Manager with expertise in Databricks to lead high-impact data engineering projects. This is a leadership role where you’ll manage a team of data engineers, design cutting-edge data architectures, and drive innovation in data engineering practices across the organization. What You’ll Do Lead and Inspire a Team

• Manage, mentor, and develop a high-performance team of data engineers.
• Collaborate with data science , analytics , and engineering teams to deliver innovative data solutions.
• Oversee the full data engineering lifecycle , ensuring timely delivery and high-quality outcomes.

Architect Scalable Data Solutions

• Design scalable data architectures on Databricks for ETL , data warehousing , and big data processing .
• Enforce data governance policies and establish best practices for seamless data processing and management.
• Build efficient data flow pipelines for cloud environments (AWS, Azure, GCP).

Optimize Databricks Performance

• Optimize Databricks clusters for cost efficiency and performance .
• Leverage Spark and Delta Lake for advanced data transformations and modeling.
• Ensure seamless integration with data lakes , SQL databases , and BI tools .

Ensure Data Quality and Security

• Monitor and enforce data quality , reliability , and security within the Databricks environment.
• Implement data validation checks and error-handling mechanisms .
• Collaborate with security teams to ensure compliance with data privacy regulations and internal standards.

Drive Innovation and Technical Excellence

• Stay ahead of the curve with the latest Databricks capabilities and cloud technology trends .
• Develop reusable code, libraries, and tools to streamline data workflows.
• Troubleshoot and resolve complex data pipeline issues , continuously improving performance and reliability .

What You Bring ✔️ Advanced experience with Databricks, Spark, and Delta Lake ✔️ Proficiency in Python , SQL , and/or Scala ✔️ Expertise in cloud platforms (AWS, Azure, GCP)✔️ 6+ years in data engineering , with 2+ years in a leadership role ✔️ Strong background in data architecture , pipeline optimization , and data modeling ✔️ Proven experience managing large-scale data systems and ETL pipelines ✔️ Familiar with Airflow for workflow orchestration and Linux administration ✔️ Excellent communication and collaboration skills ✔️ Strong problem-solving ability with keen attention to detail Why Join Us? Be part of a dynamic and innovative team that drives cutting-edge solutions in data engineering. We value diversity, encourage creativity, and offer a collaborative environment where you can thrive. Apply Now and lead the next generation of data-driven transformatio