Data Engineer - Hadoop
at Michael Page International (UAE) Limited in
Data Engineer - Hadoop Full time at Michael Page International (UAE) Limited in UAE, UAE
Job highlightsPosted on April 27, 2021
As the Data Engineer, you will manage all data related contexts ranging across addressing small to large data sets, structured/unstructured or streaming data and assisting in building enterprise-wide data pipelines.
You would also be responsible for modelling complex distributed data sets to build repositories such as data warehouses and data lakes with the aim of continuously adopting new and emerging technologies.
A top employer in the Middle East that is currently investing in new talent, technologies, and data-related strategies
Experience across a wide range of technologies within a Hadoop ecosystem such as Spark and Kafka.Provide guidance on suitable options, designing and creating data pipeline for analytical solutions data lake/data warehouses to specific microservices.Create and modify computer programs to extract information from various databases.Interact with data scientists and translators to understand how data needs to be converted, loaded, and presented.Produce data through complex SQL and other programming tools and develop reports, dashboards to feed into weekly, monthly, quarterly, and annual reports.Ability to work additional tools, technologies, and programming languages such as Alteryx, FTP, TSQL, Webservices, Tableau and Power BI, ARC GIS.
Bachelor's BS/BA or potentially master's certificate in Computer Science, Information Technology, Statistics, Math or equivalent combination of education and experience.At least 8 years' experience with data analysis and preparation, including considerable experience with big data platform such as Hadoop, Map Reduce, Spark, Hive, Kafka and Flink etc.Proficient SQL skills and experience in working with Hadoop, Hive, Map Reduce, Teradata, QSTK, R, Python, C# and Java. put away strategies, capacities, cursors, client characterised capacities, triggers, list, see).
Attractive tax-free salary and benefits. Diverse working culture with a great scope for growth.
Opportunity to join one of the fastest growing organisations in the Middle East.
To stay safe in your job search, information on common scams and to get free expert advice, we recommend that you visit SAFERjobs, a non-profit, joint industry and law enforcement organization working to combat job scams.
Improve your chance to get this job. Do an online course on IT, Computing and Technology starting now.
Web Design HTML5, CSS3 and Bootstrap Skill-UpAED 73
AED 1,837Duration: Upto 8 Hours
Level 2 Certificate in Game Development Alpha AcademyAED 51
AED 955Duration: Upto 7 Hours
SAP Success Factors E-LearnifyAED 1,286
AED 3,673Duration: Upto 60 Hours Live virtual classroom
AED 3,673Duration: Upto 3 Months Live virtual classroom