Big Data Engineer
Full time
at Discovered MENA
in
Online
Posted on May 8, 2024
Job details
Big Data Engineer
Salary: 23,000 AED per month Location: Dubai - RELOCATION REQUIRED - CANNOT BE DONE REMOTELY Big Data Engineer - Unleash Your Data Mastery! About the Dynamic IT Consultancy: Join the forefront of Dubai's tech innovation with [Company Name], a dynamic IT consultancy driving groundbreaking solutions. We're on the lookout for an exceptional Big Data Engineer to be a key player in reshaping data landscapes and propelling our clients into the future. Your Adventure Awaits: As a Big Data Engineer, you're not just shaping data; you're sculpting the future. Dive into the heart of massive datasets, craft scalable web services, and mentor the next generation of data enthusiasts.Key Responsibilities:
- Data Pioneering: Design and implement end-to-end data pipelines, turning raw data into strategic assets for our clients.
- Tech Mastery: Harness the power of Apache Beam, Apache Spark, Hadoop and more to analyse and process large datasets effectively.
- Web Service Crafting: Develop high-performance web services dedicated to tracking data, ensuring efficiency and reliability.
- Design Excellence: Translate complex technical requirements into detailed designs, providing actionable plans for seamless implementation.
- Innovation Explorer: Explore alternative solutions for data storing and processing, implementing streamlined strategies for optimal efficiency.
- Mentorship Champion: Guide and mentor junior team members, conducting technical training sessions to foster skill development.
Key Technologies:
- Apache Beam
- Apache Spark
- Hadoop
- MapReduce
- Hive
- Columnar Databases (HBase, Cassandra, Elasticsearch, etc.)
- ETL Processes
- Data Warehousing
- Java
- Python
- Scala
Qualifications:
- Bachelor's degree in Computer Science, Information Technology or a related field.
- 3-5 years of proven experience as a Big Data Engineer.
- Proficiency in Apache Beam, Apache Spark, Hadoop and other relevant big data technologies.
- Strong web service development skills and deep understanding of data processing and storage.
- Programming proficiency in Java, Python and Scala.
- Familiarity with columnar databases and ETL processes.
- Excellent problem-solving skills and the ability to translate business requirements into technical solutions.
- Strong communication and mentorship skills.
Apply safely
To stay safe in your job search, information on common scams and to get free expert advice, we recommend that you visit SAFERjobs, a non-profit, joint industry and law enforcement organization working to combat job scams.
