Início Índia Data Engineer [T500-7472]

Início Índia Data Engineer [T500-7472]

Data Engineer [T500-7472]

Full time na a Laimoon Verified Company no India
Publicado em June 13, 2024

Detalhes do emprego

Skill Required:Must Haves:Exp with D&A domain - 3yrsAzure specific & not AWS over herePandas, Scikit-Learn, Matplotlib, TensorFlow, Jupyter and other Python data tools - 2yrsSpark (Scala and PySpark), SQL and NoSQL storage toolsAzure tooling for large-scale data processing - 1yr+Azure Data Factory, DataFlow, Databricks, Python, Synapse, Building Data Pipelines - 1yr+Good to Have:Kafka and other high-volume data toolsEvent Hub / IOT, Azure Kubernetes Service (AKS), APIM, Network Design, HadoopEssential Job Duties & Responsibilities:Understanding in depth both the business and technical problems, DataWorks aims to solveBuilding tools, platforms and pipelines to enable teams to clearly and cleanly analyze data, build models and drive decisionsScaling up from "laptop-scale" to "cluster scale" problems, in terms of both infrastructure and problem structure and techniqueDelivering tangible value very rapidly, collaborating with diverse teams of varying backgrounds and disciplinesCodifying best practices for future reuse in the form of accessible, reusable patterns, templates, and code basesInteracting with senior technologists from the broader enterprise and outside of FedEx (partner ecosystems and customers) to create synergies and ensure smooth deployments to downstream operational systemsSkill/Knowledge Considered a plus:Technical background in computer science, software engineering, database systems, distributed systemsFluency with distributed and cloud environments and a deep understanding of how to balance computational considerations with theoretical propertiesDetailed knowledge of the Microsoft Azure tooling for large-scale data engineering efforts and deployments is highly preferredA compelling track record of designing and deploying large scale technical solutions, which deliver tangible, ongoing valueDirect experience having built and deployed robust, complex production systems that implement modern, data scientific methods at scaleAbility to context-switch, to provide support to dispersed teams which may need an "expert hacker" to unblock an especially challenging technical obstacle, and to work through problems as they are still being definedDemonstrated ability to deliver technical projects with a team, often working under tight time constraints to deliver valueAn 'engineering' mindset, willing to make rapid, pragmatic decisions to improve performance, accelerate progress or magnify impactComfort with working with distributed teams on code-based deliverables, using version control systems and code reviewsAbility to conduct data analysis, investigation, and lineage studies to document and enhance data quality and accessUse of agile and devops practices for project and software management including continuous integration and continuous deliveryDemonstrated expertise working with some of the following common languages and tools:Spark (Scala and PySpark), HDFS, Kafka and other high-volume data toolsSQL and NoSQL storage tools, such as MySQL, Postgres, Cassandra, MongoDB and ElasticSearchPandas, Scikit-Learn, Matplotlib, TensorFlow, Jupyter and other Python data toolsAzure/MARSMinimum QualificationsBachelor's Degree in Information Systems, Computer Science, or a quantitative discipline such as Mathematics or Engineering and/or equivalent formal training or work experience. Seven (7) years equivalent work experience in measurement and analysis, quantitativeBusiness problem solving, simulation development and/or predictive analytics. Extensive knowledge in data engineering and machine learning frameworks including design, development and implementation of highly complex systems and data pipelines.Extensive knowledge in Information Systems including design, development and implementation of large batch or online transaction-based systems. Strong understanding of the transportation industry, competitors, and evolving technologies.Experience providing leadership in a general planning or consulting setting. Experience as a leader or a senior member of multi-function project teams. Strong oral and written communication skills. A related advanced degree may offset the related experience requirements. PRB

Apply safely

To stay safe in your job search, information on common scams and to get free expert advice, we recommend that you visit SAFERjobs, a non-profit, joint industry and law enforcement organization working to combat job scams.

Share this job
Improve your chance to get this job. Do an online course on HADOOP starting now. Claim $10 promo towards online courses. See all courses
See All Data Jobs
Feedback Feedback