House of Shipping | Data Engineer | chennai
Detalhes do emprego
"House of Shipping provides business consultancy and advisory services for Shipping & Logistics companies. House of Shipping's commitment to their customers begins with developing an understanding of their business fundamentals.Currently House of Shipping is looking to identify a high caliber Data Engineer.Job purpose We are seeking a skilled and experienced Data Engineer to join our Enterprise Data Analytics team. The successful candidate will be responsible for designing, implementing, and managing data solutions using Azure Data services to support our organization's data-driven decision-making processes.This role involves developing robust, scalable, and high-performance data pipelines and architectures that ensure the efficient Extraction, Transformation, and Loading (ETL) operation of data from various sources into the Data warehouse (or) Data Lake.ResponsibilitiesData Solution Design: Design and develop data solutions on Azure that meets the business requirements and technical specifications.Data Integration: Develop and manage data integration workflows using Azure Data Factory and other relevant tools.Data Storage: Implement and manage data storage solutions using Azure Synapse SQL Pool, Azure Synapse Analytics, Azure Data Lake Storage, and other Azure services.Performance Optimization: Monitor and optimize the performance of data pipelines, queries, and storage solutions to ensure efficient data processing. Cost Management: Monitor the utilization of cloud services and adjust the properties to make it cost effective.Collaboration: Work closely with Data analyst, Developers and Business stakeholders to understand data requirements and deliver effective solutions.Troubleshooting: Identify and resolve data-related issues, ensuring data accuracy, reliability, and availability.Documentation: Create and maintain documentation for data solutions, processes, and best practices.Background and experienceBachelor's or Master's degree in computer science, Information Technology, or a related field.8 years of experience in Data warehousing or Data engineering, with at least 3 years of experience with Azure data services.Competencies and skillsProficiency in Azure Data Factory, Azure Synapse Analytics, and Azure Data Lake Storage.Strong SQL skills and experience with any other relational databases (e.g. Oracle, SQL Server, SAP BW).Experience with data modeling, ETL processes, and data integration techniques.Experience with programming languages such as Python (or) Java. Experience with developing solutions with Serverless architecture using Azure Functions.Experience with Big Data technologies and frameworks (e.g. Spark, Kafka).Familiarity with PowerBI and Data Lake house architecture is a plus.Preferred Certifications:Microsoft Certified: Azure Data Engineer Associate AGG
Apply safely
To stay safe in your job search, information on common scams and to get free expert advice, we recommend that you visit SAFERjobs, a non-profit, joint industry and law enforcement organization working to combat job scams.
