Data Engineer

Join our in-person classes at Teach Me Code’s campus in Dubai and have the best learning environment ON-SITE LEARNINGTraining in UX/UI Design Explore the features of Figma and learn how to create exceptional web and mobile UI/UX designs. By the end of this course, you will have the skills to design user-friendly and visually appealing interfaces for both web and mobile applications.Participate in real-time, interactive online classes from anywhere in the world.LIVE LEARNINGTraining in UX/UI Design Explore the features of Figma and learn how to create exceptional web and mobile UI/UX designs. By the end of this course, you will have the skills to design user-friendly and visually appealing interfaces for both web and mobile applications.Recorded: Pre-recorded sessions that you can watch at your convenience.RECORDED LEARNINGTraining in UX/UI Design Explore the features of Figma and learn how to create exceptional web and mobile UI/UX designs. By the end of this course, you will have the skills to design user-friendly and visually appealing interfaces for both web and mobile applications.Join our in-person classes at Teach Me Code’s campus in Dubai and have the best learning environment ON-SITE LEARNINGTraining in HTML for Front-End Design Gain a solid understanding of essential web technologies and become a front-end specialist. Learn how to create interactive web pages that respond to user interactions and are fully responsive across all devices. Develop the skills to build dynamic websites that provide a seamless user experience Participate in real-time, interactive online classes from anywhere in the world.LIVE LEARNINGTraining in HTML for Front-End Design Gain a solid understanding of essential web technologies and become a front-end specialist. Learn how to create interactive web pages that respond to user interactions and are fully responsive across all devices. Develop the skills to build dynamic websites that provide a seamless user experience Recorded: Pre-recorded sessions that you can watch at your convenience.RECORDED LEARNINGTraining in HTML for Front-End Design Gain a solid understanding of essential web technologies and become a front-end specialist. Learn how to create interactive web pages that respond to user interactions and are fully responsive across all devices. Develop the skills to build dynamic websites that provide a seamless user experience Full Job Description Summary Digital firm 10Pearls seeks **Data Engineer** with 3-5 years in Snowflake, AWS, and Big Data. Strong SQL, Python skills required. Experience in oil and gas data preferred.Description**Company Overview**10Pearls is an end-to-end digital technology services partner helping businesses utilize technology as a competitive advantage. We help our customers digitalize their existing business, build innovative new products, and augment their existing teams with high performance team members. Our broad expertise in product management, user experience/design, cloud architecture, software development, data insights and intelligence, cyber security, emerging tech, and quality assurance ensures that we are delivering solutions that address business needs.10Pearls is proud to have a diverse clientele including large enterprises, SMBs and high growth startups. We work with clients across industries, including healthcare/life sciences, education, energy, communications/media, financial services, and hi-tech. Our many long-term, successful partnerships are built upon trust, integrity and successful delivery and execution.**Requirements**Ideal candidate should have a Bachelor’s degree in Computer Science with 3 – 5 years of programming in Snowflake, AWS, Glue, ETL pipeline Athena, Hadoop, Big Data.**Responsibilities**Develop, construct, test and maintain optimal data pipeline architecture. Assemble large, complex data sets that meet functional / non-functional business requirements. Identify ways to improve data reliability, efficiency and quality. Prepare data for predictive and prescriptive modeling.Use data to discover tasks that can be automated. ETL pipeline build, deployment and operations, data quality, monitoring and alerting, CI/CD, governance, access control, etc. Design and implement efficient and scalable data pipelines, including data ingestion, transformation, and storage, using Snowflake and other relevant technologies. Stay up-to-date with industry best practices and emerging technologies related to data architecture, data modeling, Snowflake, and AWS.Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc. Monitoring processes performance and advising any necessary changes.Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs. Create data tools for analytics that assist in building and optimizing the product into an innovative industry leader. Work with data and analytics experts to strive for greater functionality in our data systems. Demonstrate proficiency in data management and automation on Spark, Hadoop, and HDFS environments.**Required Skills**Bachelor’s or Master’s in Computer Science, Data Engineering, or a related field. 3-5 years of experience in data engineering, with exposure to oil and gas data sources preferred. Strong knowledge of SQL, Python, and data pipeline tools (e.g., Apache Airflow, Luigi). Experience with cloud platforms (AWS, Azure, Google Cloud) and big data frameworks. Familiarity with oil and gas-specific software and data types is a plus.Powered by Jazz HR #J-18808-Ljbffr