Azure Data Engineer

Job Title: Azure Data Engineer Experience: 5+ Years as Azure Data EngineerLocation: Hyderabad, Work from Office on HybridWorking Hours: 12.00pm to 9.00pmRequired Skills:#Azuredataengineer #Azuredatafactory #Azuredatalakes #python #SQL #powerbiAt Clean Harbors, we are seeking Azure Data Engineers. The Data Engineer will be responsible for designing, implementing, and managing data solutions on the Microsoft Azure cloud platform. This role involves working with various data storage options offered by Microsoft Azure, developing, and implementing data integration processes, and using big data technologies to handle and analyze large volumes of data for multiple purposes. In addition, the role requires supporting AI implementations and Power BI reporting.Key Responsibilities:Ensure that Health and Safety is the number one goal by following policies, processes, and always acting in a safe manner.Design data storage systems that scale, perform, and are economical enough to satisfy the organization's requirements.Develop and implement data integration processes, frequently using Azure Data Factory, to extract, transform, and load (ETL) data from various sources into Azure data warehouses or data lakes.Use big data technologies like Apache Spark to handle and analyze enormous volumes of data.Collaborate with data scientists to create data sets and engineer features for AI InitiativesImplement and optimize data retrieval for Power BI solutions.What does it take to work for Clean Harbors?A master's degree in computer science, Statistics, Mathematics, or a related field is required. A bachelor's degree with significant relevant experience would suffice.5+ years of data engineering experience leveraging technologies such as Azure Data Factory, Azure Synapse Analytics, Azure Stream Analytics, Azure Event Hubs, Azure Data Lake Storage, Azure DatabricksExperience with data pipelines and engineering infrastructure: You should have experience designing and implementing data pipelines and engineering infrastructure for machine learning systems.Solid knowledge of data processing languages, including SQL, Python, Scala.Experience with AI implementations and Power BI.Experience with Microsoft Azure's data services: You should have hands-on experience with various data services offered by Microsoft Azure, such as Azure Machine Learning, Azure Databricks, and Azure Data Factory.Familiarity with Azure Cognitive Services for integrating AI capabilities (like vision, language, and decision functionalities) directly into applications.Ability to work with large datasets and experience with data processing tools like SQL, Pandas, and big data technologies such as Apache Spark.Proficiency in Python, .NET C#, API developmentExperience with SQL, NoSQL databases and Data Fabric architectures.Strong communication skills to effectively collaborate with team members and stakeholders.Strong problem-solving skills and ability to think algorithmically.Ability to translate complex findings into a compelling narrative for non-technical stakeholders.Certifications like Microsoft Certified: Azure Data Engineer Associate will be preferred. PRB