Lead Data Engineer

Job Role: Lead Data Engineer Job Location: Bangalore Job Description : Design, develop, and maintain scalable and efficient data pipelines using Python, Pandas, Spark, and Dataflow. Strong background in relational databases such as SQL Server or MySQL along with a deep understanding of the Cloud Platform. Putting together large, intricate data sets to satisfy both functional and non-functional business needs. Analyze and integrate disparate systems / data using ETL processes and logic to provide timely and accurate information to visualization team and business stakeholders. Optimize and troubleshoot data pipelines for performance, reliability, and scalability. Ensure data integrity and quality throughout the pipeline by implementing validation and testing strategies. Determining, creating, and implementing internal process improvements, such as redesigning infrastructure for increased scalability, improving data delivery, and automating manual procedures Collaborate with cross-functional teams to understand data requirements and implement solutions that meet business needs. Develop and maintain documentation for data pipelines, including design documents, code comments, and operational guides. Provide technical support for production issues including troubleshooting, query and process optimization. Provide technical guidance and mentorship to junior team members, promoting best practices and continuous learning. Having knowledge on analytics using PowerBI, Tableau, Data studio and Apache SuperSet Work Experience & Qualifications Proven 7 to 9 Yrs. in design and development. Excellent customer-facing and internal communication skills. A bachelor’s degree in computer science / information science / data science.