Data Engineer

Full time at a Laimoon Verified Company in Qatar

Posted on January 16, 2025

Job details

About the roleResponsible for creating reliable software programs for building highly scalable data pipelines to collect a large amount of data from different sources and transform it into a usable format for analysis. Responsibilities include building real-time and batch data ingestion pipelines, setting up of data catalogues, data warehouses, data cleansing, data transformation, data processing and data visualization to provide real-time intelligence to businesses.Roles and ResponsibilitiesConstruct, deploy, test and maintain highly scalable and optimized data pipelines with state-of-the-art monitoring and logging practices.Develop software programs or use tools to bring together large, complex and sparse data sets to meet functional and non-functional business requirements and use a variety of languages, tools and frameworks to marry data.Design and implement data tools for analytics and data scientist team members to help them in building, optimizing and tuning of use cases.Develop and manage data warehouses to ensure the availability, performance, scalability and security of production data warehouse.Develop software programs or use tools for cleansing and harmonization of data from a variety of data sources.Defines data catalogues, metadata to provide search ability and governance (including Records Management) for structured and unstructured data.Implement best practices in management of data, including master data, reference data, metadata, data quality and lineage in assigned areas.QualificationsBachelor's Degree or Equivalent with Minimum 4 years of job-related experienceHands-on experience in working with big data using technologies like Hadoop/Hive, Hyperscale PostgreSQL, Java/Scala, Spark, Kafka, SQL and NoSQL, azure cloud-based data engineering solutionsHands on experience with data ingestion tools (ex: striim, streamsets, NiFi).Hands-on experience in data modelling, data visualization, and pipeline design & development.Hands on experience with data warehouse platforms (ex: Snowflake, Azure Data Lake Analytics).Strong technical knowledge of performance tuning and query optimization on large data sets.How to apply (External)If you're ready to join a progressive team and have a challenging and rewarding career, then apply now by uploading your CV and completing our quick application form.

#J-18808-Ljbffr Database, Analytics & BI

Apply safely

To stay safe in your job search, information on common scams and to get free expert advice, we recommend that you visit SAFERjobs, a non-profit, joint industry and law enforcement organization working to combat job scams.

Hiring company

Confidential

Improve your chance to get this job. Do an online course on HADOOP starting now.

Become a Big Data Hadoop Expert eduCBA

AED 77
~~AED 349~~

Duration: 28 Hours

Enrol
Big Data Hadoop: SQL & NoSQL Skill-Up

AED 50

Duration: Upto 23 Hours

Enrol

See all courses

See All Data Jobs

Data Engineer

Job details

Apply safely

Hiring company

Confidential

PRINCIPAL RESERVOIR ENGINEER

Reservoir Engineer (Unconventional)

Telecom Engineer

Head - Subsurface Data Management

System Engineering Lead - Digital Lead

Control Engineer - Maintenance

Material Handling Engineer- Piping & Layout

Head of Project Engineering

Workover Supervisor / Workover Engineer

Lifting Engineer

SR. PRINCIPAL RESERVOIR ENGINEER

SR. PRINCIPAL RESERVOIR ENGINEER

PRINCIPAL PETROPHYSICIST

Directional Systems - Doha - Qatar

Hook-up Manager

SR. DESIGN DRAFTSMAN

Head of Center of Excellence, Qatar

Head of Center of Excellence, Qatar

Head of Center of Excellence, Qatar

Jobs

Courses

Location

Follow us

Home Qatar Data Engineer

Home Qatar Data Engineer

Data Engineer

Job details

Apply safely

Hiring company

Confidential

Similiar Jobs that might interest you

PRINCIPAL RESERVOIR ENGINEER

Reservoir Engineer (Unconventional)

Telecom Engineer

Head - Subsurface Data Management

System Engineering Lead - Digital Lead

Control Engineer - Maintenance

Material Handling Engineer- Piping & Layout

Head of Project Engineering

Workover Supervisor / Workover Engineer

Lifting Engineer

SR. PRINCIPAL RESERVOIR ENGINEER

SR. PRINCIPAL RESERVOIR ENGINEER

PRINCIPAL PETROPHYSICIST

Directional Systems - Doha - Qatar

Hook-up Manager

SR. DESIGN DRAFTSMAN

Head of Center of Excellence, Qatar

Head of Center of Excellence, Qatar

Head of Center of Excellence, Qatar

Why are you reporting this job?

Laimoon Job Alert fresh jobs directly from websites*

Jobs

Courses

Location

Follow us