Data Engineering Lead

Job DescriptionWe are committed to building robust data infrastructure that empowers decision-making, optimizes processes, and delivers value to our stakeholders. As the Data Engineering Lead, you will play a pivotal role in designing and scaling our data systems to meet evolving business needs.Key Responsibilities:Technical Leadership and Strategy:Technically lead the Data Engineering team, providing guidance, mentorship, and technical oversight.Define and implement the vision for Adalfi's data architecture and engineering strategy.Collaborate with stakeholders to align data solutions with business objectives.Data Architecture and Development:Design, build, and maintain scalable, reliable, and secure data pipelines to support analytics, reporting, and machine learning use cases.Architect and optimize data storage solutions, ensuring high performance and cost efficiency.Oversee ETL/ELT processes for transforming raw data into usable formats.Technical Expertise:Implement and advocate for best practices in data engineering, including coding standards, testing, and deployment.Stay updated with industry trends and emerging technologies in data engineering, applying them as needed.Work closely with Data Engineers, Analysts, and other teams to provide the necessary infrastructure and tools.Operational Excellence:Establish monitoring, alerting, and performance tuning processes for data systems.Ensure data quality, integrity, and security compliance across all pipelines and platforms.Manage the team's project timelines and deliverables, ensuring milestones are met.RequirementsTechnical Skills:Proven experience in data engineering roles, with a minimum of 5+ years in the field.Proficiency in programming languages such as Python.Deep understanding of SQL and database technologies (e.g., SQL Server, Snowflake, Redshift).Hands-on experience with data pipeline orchestration tools (e.g., Apache Airflow, SSIS).Expertise in distributed data processing frameworks like Apache Spark.Familiarity with cloud platforms (e.g., AWS, Azure) and their data services.Strong knowledge of data modeling, data warehousing, and big data technologies.Leadership Skills:Experience in managing and mentoring teams of data engineers or developers.Excellent communication skills to convey complex technical concepts to non-technical stakeholders.Ability to foster collaboration and drive consensus in cross-functional teams.Preferred Qualifications:Bachelor's or Master's degree in Computer Science, Data Science, or a related field.Kindly note that this is not a pure Management position and requires extensive knowledge of technical background around Data Engineering, Data Warehousing, Data Governance, Snowflake and associated technologies.Benefits:Competitive SalaryProvident FundMedical (OPD & IPD Parent Also Covered)Life InsuranceEOBIPaid TrainingsAdditional Requirements:5+ years' experience with leading the design and implementation of enterprise IT SolutionsMinimum Bachelor's Degree in Computer Science, IT or EngineeringExperience with CI/CD tool chain (Jenkins, Kubernetes)Knowledge of high availability, disaster recovery, auto-scaling and auto-healing concepts

#J-18808-Ljbffr Engineering