Data Engineering Advisor

About Evernorth:Evernorth Health Services, a division of The Cigna Group (NYSE: CI), creates pharmacy, care, and benefits solutions to improve health and increase vitality. We relentlessly innovate to make the prediction, prevention, and treatment of illness and disease more accessible to millions of people.Role Title:Software Engineering AdvisorPosition Summary:Data engineer on the Data integration teamJob Description & Responsibilities:Work with business and technical leadership to understand requirements.Design to the requirements and document the designsAbility to write product-grade performant code for data extraction, transformations and loading using Spark, Py-SparkDo data modeling as needed for the requirements.Write performant queries using Teradata SQL, Hive SQL and Spark SQL against Teradata and HiveImplementing dev-ops pipelines to deploy code artifacts on to the designated platform/servers like AWS.Troubleshooting the issues, providing effective solutions and jobs monitoring in the production environmentParticipate in sprint planning sessions, refinement/story-grooming sessions, daily scrums, demos and retrospectives.Experience Required:Overall 8-10 years of experienceExperience Desired:Strong development experience in Spark, Py-Spark, Shell scripting, Teradata.Strong experience in writing complex and effective SQLs (using Teradata SQL, Hive SQL and Spark SQL) and Stored ProceduresHealthcare domain knowledge is a plusEducation and Training Required:Primary Skills:Excellent work experience on Databricks as Data Lake implementationsExperience in Agile and working knowledge on DevOps tools (Git, Jenkins, Artifactory)AWS (S3, EC2, SNS, SQS, Lambda, ECS, Glue, IAM, and CloudWatch)Databricks (Delta lake, Notebooks, Pipelines, cluster management, Azure/AWS integrationAdditional Skills:Experience in Jira and ConfluenceExercises considerable creativity, foresight, and judgment in conceiving, planning, and delivering initiatives.