Home UAE Big Data Engineer

Home UAE Big Data Engineer

Big Data Engineer

Full time at AI Staffing Ninja in UAE
Posted on March 31, 2024

Job details

Job Description:

We are seeking a talented and experienced Big Data Engineer to join our team. As a Big Data Engineer, you will be responsible for designing, implementing, and maintaining our company's big data infrastructure. You will collaborate closely with data scientists, analysts, and other stakeholders to ensure that our data pipelines are efficient, reliable, and scalable. The ideal candidate will have a strong background in big data technologies, excellent problem-solving skills, and a passion for working with large volumes of data.

Responsibilities:

  1. Design, develop, and maintain big data infrastructure and data pipelines.
  2. Work closely with data scientists and analysts to understand their requirements and translate them into technical solutions.
  3. Optimize and tune data pipelines for performance and scalability.
  4. Implement data security and privacy measures to protect sensitive information.
  5. Troubleshoot and resolve issues related to data processing and data quality.
  6. Stay current with emerging technologies and best practices in big data and distributed computing.
  7. Collaborate with cross-functional teams to integrate data from various sources and systems.
  8. Document system architecture, processes, and procedures.

Requirements:

  • Bachelor's degree or higher in Computer Science, Engineering, or a related field.
  • 3+ years of experience working as a Big Data Engineer or a similar role.
  • Proficiency in big data technologies such as Hadoop, Spark, Kafka, Hive, and HBase.
  • Experience with distributed computing and parallel processing frameworks.
  • Strong programming skills in languages such as Java, Scala, or Python.
  • Experience with cloud platforms such as AWS, Azure, or Google Cloud.
  • Knowledge of SQL and database technologies (e.g., MySQL, PostgreSQL).
  • Excellent problem-solving and analytical skills.
  • Strong communication and collaboration skills.

Preferred Qualifications:

  • Experience with containerization and orchestration tools such as Docker and Kubernetes.
  • Familiarity with machine learning algorithms and techniques.
  • Certifications in relevant technologies (e.g., AWS Certified Big Data - Specialty).
  • Experience working in an Agile development environment.
#J-18808-Ljbffr

Apply safely

To stay safe in your job search, information on common scams and to get free expert advice, we recommend that you visit SAFERjobs, a non-profit, joint industry and law enforcement organization working to combat job scams.

Share this job
Improve your chance to get this job. Do an online course on HADOOP starting now. Claim $10 promo towards online courses. See all courses
See All Big Jobs
Feedback Feedback