Data Engineer

Looking for Immediate Joiners. Location: Pune/Yervada Experience: 4+ Years What experience you need: • Bachelor’s degree in computer science, software engineering, or a similar field. • Must have Experience in the Big Data technologies (NiFi, Hadoop, Spark, Hive, MapReduce, Impala, Looker, Elastic Search) • Experience in Kafka, Jupyter • Relevant data engineering, data infrastructure, DataOps, DevOps, SRE, or general systems engineering experience.. • 6+ years of experience in managing large production platforms. • 4+ years of experience in industry standard CI/CD tools (Git, BitBucket, Jenkins, Chef, Ansible) • Experience architecting and implementing data governance processes and tooling (data catalogs, lineage tools, role-based access control, PII handling) • Strong coding ability in Python or other languages like Java, C#, Golang, C, C++, Shell script, Perl or Ruby etc., and a solid grasp of SQL fundamentals. • Experience with algorithms, data structures, scripting, pipeline management, and software design. • Systematic problem-solving approach, coupled with strong communication skills and a sense of ownership and drive. • Ability to help debug and optimize code and automate routine tasks. • Ability to support many different stakeholders. Experience in dealing with difficult situations and making decisions with a sense of urgency is needed. • Interest in designing, analyzing and troubleshooting large-scale distributed systems. • Appetite for change and pushing the boundaries of what can be done with automation. • Experience in working across development, operations, and product teams to prioritize needs and to build relationships is a must. • Experience designing and implementing an effective and efficient CI/CD flow that gets code from dev to prod with high quality and minimal manual effort is desired. • Good Handle on Change Management and Release Management aspects of Software.