Azure Data Platform Engineer

business IDC Technologies
location_on Abu Dhabi
work full-time
A month ago

Description

Senior Platform Engineer - Azure We are seeking a Senior Platform Engineer proficient in distributed system architectures and Azure Data Engineering services, including: Event Hub Data Factory ADLS Gen2 Cosmos DB Synapse Databricks APIM, Function App, Logic App, and App Services Responsibilities include: Implementing and managing infrastructure using Ia C tools such as ARM templates and Terraform. Managing containerized applications with Docker and orchestrating with Azure Kubernetes Service (AKS). Setting up and managing monitoring, logging, and alerting systems using Azure Monitor, Log Analytics, and Application Insights. Implementing disaster recovery strategies, backups, and failover mechanisms for critical workloads. Automating infrastructure provisioning, scaling, and management for high availability and efficiency. Managing and maintaining clusters across various environments on Azure. Defining scheduling and monitoring job flows with proactive alert setup. Troubleshooting failed jobs in Azure tools like Databricks and Data Factory, performing root cause analysis, and applying corrective measures. Hands-on experience with distributed streaming tools like Event Hub. Designing and managing backup and disaster recovery solutions using Ia C with Terraform. Automating processes using Python, shell scripting, Jenkins, and Azure Dev Ops. Designing and maintaining Azure CI/CD pipelines for seamless code integration, testing, and deployment. Monitoring and troubleshooting VM resources and applications, advising developers on performance improvements. Reviewing and resolving log file issues for system and application components. Adapting to evolving technologies with a strong sense of responsibility and accomplishment. Applying agile methodologies for software delivery. We require a Data Platform Engineer with a strong understanding of Azure administration and Azure Dev Ops, with expertise in: Storage Account Data Lake (ADLS) Databricks Unity Catalog, including table types, Parquet vs Delta, Optimize, Vacuum, Security, Segregation, job slowness issues, version control Azure Data Factory (ADF) Event Hub and Event Grid, message flow issues, Terraform setup Key Vault Cosmos DB Synapse Location: Abu Dhabi, United Arab Emirates #J-18808-Ljbffr

Posted: 7th July 2025 6.05 pm

Application Deadline: N/A

Apply Now

Similar Jobs

Explore more opportunities like this

Senior Data Scientist

ClearPeaks
, Abu Dhabi Emirate, United Arab Emirates
full-time
2 months ago
View Details

Engineer - Site Reliability

Presight
Abu Dhabi
full-time
2 months ago
View Details

Data Architect (Abu Dhabi)

Xebia
Abu Dhabi
full-time
2 months ago
View Details

Engineer - Site Reliability

G42
Abu Dhabi
full-time
2 months ago
View Details

Mid-Level Cyber Security Engineer

Nxdt
Abu Dhabi
full-time
2 months ago
View Details

Data Architect

IQ Data
Abu Dhabi
full-time
2 months ago
View Details

Mid-Level Cyber Security Engineer

Nxdt
Abu Dhabi
full-time
2 months ago
View Details

Senior Manager – AI and Smart Data

Confidential
, Abu Dhabi Emirate, United Arab Emirates
full-time
2 months ago
View Details