Senior Data Engineer

Get AI-powered advice on this job and more exclusive features.Hastraa Consulting Services is a global Software Testing & Quality Assurance Services organization with headquarters in Singapore. Hastraa has a testing competency and offshore delivery center in Malaysia, and international offices in Dubai, UK, and India. Specializing in Banking & Financial Services, Insurance, and Telecom verticals, Hastraa has executed over 100 projects for 40+ customers in South East Asia, Middle East, and Europe.Role Description This is a full-time on-site role for a Senior Data Engineer located in Dubai. The profile should have extensive experience in the Big Data space (Hadoop Stack like M/R, HDFS, Pig, Hive, HBase, Flume, Sqoop, No SQL stores like Cassandra, HBase, etc.) and contribute to open-source Big Data technologies.Write and tune complex Java, Map Reduce, and Hive jobs.Experience leading a Backend/Distributed Data Systems team while remaining hands-on is very important.Manage the business intelligence team and vendor partners, ensuring project priorities according to customer and internal needs, and develop top-quality dashboards using industry best practices.Manage a team of data engineers (both full-time associates and/or third-party resources).Analyze and confirm the integrity of source data to be evaluated.Lead deployment and auditing models and attributes for accuracy.Experience with stream-processing systems such as Spark-Streaming, Storm, etc.Experience with object-oriented/object function scripting languages like Python, Scala, etc.Design and build dimensional data models to improve data accessibility, efficiency, and quality.Proficient in writing advanced SQLs, with expertise in performance tuning of SQLs. Experience with data science and machine learning tools is a plus.Experience with relational SQL and No SQL databases, including Postgres and Cassandra.Experience with Azure cloud services is a plus.Knowledge of Financial Services is a plus, especially for banking clients.Qualifications10+ years of experience as a big data engineer.In-depth knowledge of Hadoop (Cloudera), Spark, and similar frameworks.Good knowledge of Big Data querying tools such as Pig, Hive, and Impala.Knowledge of scripting languages including Java, C++, Linux, Ruby, PHP, Python, and R.Owns most deliverables for the Big Data team from a delivery perspective.Ability to solve complex networking, data, and software issues.Ability to effectively plan and organize work.Strong interpersonal communication skills.Assist others in completing their tasks to support team goals.Build and maintain cooperative work relationships.Bachelor's or Master's degree in Computer Science, Data Science, or a related field.Interested candidates can share their resumes at raghunath@hastraa.com.#BSFI #Big Data #Hadoop #Open To Work #On Site #Dubai Seniority Level Mid-Senior level Employment Type Full-time Job Function Information Technology Industries IT Services and IT Consulting Referrals increase your chances of interviewing at Hastraa Consulting Services by 2x.#J-18808-Ljbffr