AWS Data Engineer
Job details
Job Summary: We are looking for a highly skilled AWS Data Engineer with 5-6 years of experience to join our dynamic team. The ideal candidate will have hands-on experience with AWS services, data engineering best practices, and a strong understanding of building, deploying, and maintaining data pipelines in the cloud. You will be responsible for designing and implementing scalable and efficient data solutions to support business analytics and operational processes. Work hours are morning as per Australian time zone. Key Responsibilities:
- Design, develop, and maintain scalable data pipelines on AWS, ensuring efficient ETL processes.
- Work with different AWS services like S3, Redshift, Lambda, Glue, EMR, and RDS to implement data architecture.
- Collaborate with data analysts and stakeholders to understand data requirements and translate them into efficient data models and processes.
- Optimize data flow and pipeline performance for large datasets.
- Ensure data quality, integrity, and security throughout the entire lifecycle of data processing.
- Automate and maintain CI/CD pipelines for data engineering projects.
- Develop and maintain documentation for data engineering processes.
- Monitor and troubleshoot performance and reliability issues with data pipelines.
- Keep up with the latest trends and best practices in data engineering and AWS services.
- 5-6 years of experience as a Data Engineer or in a similar role.
- Expertise in AWS cloud technologies (S3, Redshift, Glue, EMR, Lambda, RDS, Athena, Kinesis).
- Proficiency in SQL and experience working with relational and NoSQL databases.
- Strong programming skills in Python or Java for data processing.
- Experience with data pipeline orchestration tools such as Apache Airflow or AWS Step Functions.
- Hands-on experience with ETL processes and designing scalable data architectures.
- Knowledge of data warehousing concepts and best practices.
- Experience with data version control, CI/CD pipelines, and DevOps practices.
- Strong problem-solving skills and attention to detail.
- AWS Certified Data Analytics or AWS Certified Solutions Architect.
- Experience with Big Data tools like Hadoop, Spark, or similar technologies.
- Familiarity with data governance, security best practices, and compliance standards (GDPR, HIPAA, etc.).
- Experience with real-time data streaming technologies such as Apache Kafka or AWS Kinesis.
- Competitive salary package.
- Opportunity to work with cutting-edge AWS technologies.
- Flexible working hours and work-from-home options.
- Opportunities for professional growth and certification.
Apply safely
To stay safe in your job search, information on common scams and to get free expert advice, we recommend that you visit SAFERjobs, a non-profit, joint industry and law enforcement organization working to combat job scams.
