Senior Data Engineer

DescriptionAbout the role:Maltem is a leading data and analytics company that leverages cutting-edge technology to drive innovation and transform data into actionable insights. We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team and play a key role in shaping our data architecture.Responsibilities:- Design, develop, and maintain scalable data pipelines using Databricks and Azure technologies.- Collaborate with cross-functional teams to understand data requirements and implement efficient and robust solutions.Databricks and Azure Expertise:- Utilize Databricks for advanced analytics, data engineering, and machine learning tasks.- Implement and optimize data storage, processing, and retrieval using Azure services such as Azure Data Lake Storage, Azure SQL Data Warehouse, and others.Data Quality and Governance:- Implement best practices for data quality, data governance, and metadata management.- Ensure compliance with industry standards and data privacy regulations.Performance Optimization:- Fine-tune and optimize data processes for maximum performance and efficiency.- Monitor and troubleshoot data engineering pipelines to identify and resolve issues promptly.Collaboration and Leadership:- Lead and mentor junior data engineers, fostering a collaborative and innovative team environment.- Collaborate with Data Scientists, Analysts, and other stakeholders to understand data requirements and deliver high-quality solutions.Qualifications:Bachelor's or Master's degree in Computer Science, Data Science, or a related field.Proven experience as a Data Engineer with expertise in Databricks and Azure.Strong programming skills in languages such as Python, Scala, or Java.In-depth knowledge of data modeling, ETL processes, and data integration techniques.Experience with data warehousing, big data technologies, and cloud-based data solutions.Excellent communication skills and the ability to convey complex technical concepts to non-technical stakeholders.About Maltem Australia:Maltem Australia is a renowned digital transformation and technology consulting firm, and we are excited to offer a unique opportunity for an Application Support Analyst to join our team as a consultant, working closely with a major energy provider.We're looking for a dedicated professional to provide application support and business understanding to enhance the operations of our client in the energy trading sector.How to Apply:If you are passionate about the energy trading sector, committed to understanding business issues, and ready to make a significant impact in application support while working as a consultant, we encourage you to apply.To be considered for this unique position, please submit your resume and a cover letter detailing your relevant experience and qualifications to rpillai@maltem.com.Maltem Australia is dedicated to fostering diversity and inclusion in our workforce and welcomes applicants from all backgrounds.Role Type

#J-18808-Ljbffr Database, Analytics & BI