Senior Data Engineer (GCP)

Full time at a Laimoon Verified Company in Qatar

Posted on November 25, 2024

Job details

Title: Senior Data Engineer (GCP)Location:Job Type: Full-TimeAbout Us:Logic Hire Software Solutions is an innovative data-centric organization committed to leveraging advanced analytics and data engineering practices to inform strategic business decisions and improve client engagement. We are seeking a seasoned Senior Data Engineer to join our team and contribute to the optimization and expansion of our data infrastructures.Job Description:We are in search of a highly proficient Senior Data Engineer with over 12+ years of hands-on experience in architecting and maintaining data infrastructure. The ideal candidate will possess extensive expertise in leveraging the Google Cloud Platform (GCP) and the BigQuery ecosystem, alongside strong commands in SQL, SSIS (SQL Server Integration Services), SSRS (SQL Server Reporting Services), and Python. This role necessitates a combined technical acumen and strong interpersonal skills to successfully engage with business units while supporting the overall project lifecycle.Key Responsibilities:

Architect, implement, and maintain high-performance data pipelines utilizing GCP services, particularly BigQuery, Cloud Storage, Cloud Functions, and Dataflow, ensuring optimal data flow and accessibility.

Design and write highly efficient, scalable SQL queries, including complex joins, CTEs, and aggregations, to enable robust data analysis and reporting across multiple operational facets.

Develop ETL (Extract, Transform, Load) processes using SSIS for operational data integration and leverage SSRS for generating executive-level reporting and analytics dashboards.

Employ Python to create production-quality scripts and applications for data ingestion, transformation, and visualization, utilizing libraries such as Pandas, NumPy, or Apache Airflow for orchestrating workflows.

Engage with cross-functional teams to elicit, document, and analyze business requirements, subsequently translating these into comprehensive technical specifications, data models, and workflows.

Implement and uphold data governance frameworks to ensure data integrity, quality control, and security protocols across all data engineering processes.

Monitor data pipelines and system performance metrics, identifying bottlenecks and implementing solutions to optimize throughput and minimize downtime.

Provide analytical insights and recommendations to project and client management, facilitating data-driven decision-making.

Mentor junior data engineering staff, cultivating an environment of knowledge sharing and professional development.

Stay abreast of latest trends in data engineering technologies, tools, and methodologies to continually refine our data practices.

Qualifications:

Bachelor's degree in Computer Science, Engineering, Data Science, or a related discipline; a Master's degree is highly desirable.

A minimum of 8 years of experience in the field of data engineering, particularly within GCP and the BigQuery architecture.

Profound experience in formulating and executing complex SQL queries and a solid understanding of relational database design principles.

Advanced proficiency with SSIS for ETL processes and SSRS for business intelligence reporting.

Strong programming skills in Python, with a focus on data manipulation and the development of scalable ETL solutions.

Demonstrated ability in constructing, deploying, and maintaining data engineering pipelines utilizing modern best practices.

Strong verbal and written communication skills, complemented by an ability to liaise effectively between technical teams and business stakeholders.

Exceptional analytical and problem-solving capabilities, with a proactive approach towards diagnosing and resolving issues.

Working knowledge of data governance principles, compliance with data privacy regulations, and industry best practices.

Preferred Skills:

Familiarity with additional GCP services such as Cloud Dataflow for stream/batch processing, Dataproc for managing Hadoop/Spark clusters, or Pub/Sub for messaging services.

Understanding of machine learning concepts and frameworks (e.g., TensorFlow, scikit-learn) to integrate predictive analytics within data solutions.

Experience working within Agile environments and proficiency with project management tools (e.g., JIRA, Trello).

What We Offer:

A competitive salary and comprehensive benefits package.

Opportunities for continued professional development and advancement within a cutting-edge environment.

A collaborative workspace that encourages innovation and creativity.

Flexible working options to support work-life balance.

If you possess the expertise and are eager to advance your career by driving impactful data initiatives at Logic Hire we invite you to apply. Please submit your resume and a cover letter detailing your relevant qualifications and accomplishments.Communication in English should be proficient.Note: This position requires you to relocate to Portugal - Lisbon (Visa will be provided).

#J-18808-Ljbffr

Apply safely

To stay safe in your job search, information on common scams and to get free expert advice, we recommend that you visit SAFERjobs, a non-profit, joint industry and law enforcement organization working to combat job scams.

See All Senior Jobs

Senior Data Engineer (GCP)

Job details

Apply safely

Hiring company

Confidential

Senior Principal Engineer - Process (Deputy PSL) Brownfield

Senior Principal Engineer - Control System

ENGINEERING MANAGER

Senior Project Performance & Reporting Analyst

Senior Principal - Material and Corrosion

Senior Engineer - Material Handling

Senior Principal - Material and Corossion

Senior Analyst (Cyber Security)

Senior Operator

SR. PETROLEUM ENGINEER

Head of Project Engineering

CONTROL SYSTEM SENIOR TECHNICIAN

CYBER SECURITY SENIOR TECHNICIAN

Control System Engineer

Reservoir Engineer (Unconventional)

NETWORKING ENGINEER

Telecom Engineer

Structural Engineer

TELECOM ENGINEER

Jobs

Courses

Location

Follow us

Home Qatar Senior Data Engineer (GCP)

Home Qatar Senior Data Engineer (GCP)

Senior Data Engineer (GCP)

Job details

Apply safely

Hiring company

Confidential

Similiar Jobs that might interest you

Senior Principal Engineer - Process (Deputy PSL) Brownfield

Senior Principal Engineer - Control System

ENGINEERING MANAGER

Senior Project Performance & Reporting Analyst

Senior Principal - Material and Corrosion

Senior Engineer - Material Handling

Senior Principal - Material and Corossion

Senior Analyst (Cyber Security)

Senior Operator

SR. PETROLEUM ENGINEER

Head of Project Engineering

CONTROL SYSTEM SENIOR TECHNICIAN

CYBER SECURITY SENIOR TECHNICIAN

Control System Engineer

Reservoir Engineer (Unconventional)

NETWORKING ENGINEER

Telecom Engineer

Structural Engineer

TELECOM ENGINEER

Why are you reporting this job?

Laimoon Job Alert fresh jobs directly from websites*

Jobs

Courses

Location

Follow us