AWS Data Engineer Market related

AWS Data Engineer

Duties & Responsibilities

• Exceptional analytical skills analyzing large and complex data sets.
• Perform thorough testing and data validation to ensure the accuracy of data transformations.
• Strong written and verbal communication skills, with precise documentation.
• Self-driven team player with ability to work independently and multi-task.
• Experience building data pipeline using AWS Glue or Data Pipeline, or similar platforms.
• Familiar with data stores such as AWS S3, and AWS RDS or DynamoDB.
• Experience and solid understanding of various software design patterns.
• Experience preparing specifications from which programs will be written, designed, coded, tested, and debugged.
• Strong organizational skills. Experience developing and working with REST APIs is a bonus.
• Basic experience in Networking and troubleshooting network issues.

Desired Experience & Qualification

• Degree
• Certifications such as AWS Certified Cloud Practitioner, AWS Certified SysOps Associate, AWS Certified Developer Associate, AWS Certified Architect Associate, AWS Certified Architect Professional, Hashicorp Certified Terraform Associate
• Automotive industry experience
• Terraform
• Python 3.x
• Py Spark
• Boto3
• ETL
• Docker
• Powershell / Bash
• Must have 3 – 5 years working experience
• 3 – 5 years experience in working with Enterprise Collaboration tools such as Confluence, JIRA
• 3 – 5 years experience developing technical documentation and artifacts.
• Knowledge of data formats such as Parquet, AVRO, JSON, XML, CSV
• Experience working with Data Quality Tools such as Great Expectations
• Knowledge of the Agile Working Model