SAS E-Miner (BPS : KPO Statistical Tools - SAS)
Full time
at Tata Consultancy Servicess
in
India
Posted on January 16, 2025
Job details
AWS Data Engineer Job Description Pan india Responsibilities:
- Participate in efforts to design, build, and develop rapid solutions and services
- Implement ETL/ELT Processes: Develop Extract, Transform, Load (ETL) or Extract, Load, Transform (ELT) workflows to seamlessly move data from source systems to Data Warehouses, Data Lakes, Open Source and AWS tools.
- Build applications using Python, SQL and AWS
- Be a key team member in design and development of the Data pipeline.
- Apply knowledge of basic principles, methods and practices to simple and moderately complex assignments
- Proactively identify and implement opportunities to automate tasks and develop reusable frameworks
- Implement standardized, automated operational and quality control processes to deliver accurate and timely data and reporting to meet or exceed SLAs
- Collaborate with the other engineering team members to ensure all services are reliable, maintainable, and well-integrated into existing platforms
- Review functional and technical designs to identify areas of risk and/or missing requirements
- Provide technical write-ups and drawings to promote the proposed solutions.
- 6-7 years’ experience with automation of DevOps build
- Experience working directly with technical and business teams
- Demonstrable experience using AWS Glue, AWS Lambda , Amazon Kinesis, Amazon Athena, Amazon Redshift, Amazon Cloud watch, Amazon SNS and AWS Step Functions .
- Strong experience with modern programming languages such as Python, Spark, and Scala.
- Create Email alerts to send any notification mail.
- Create new airflow DAG's and workflows for each source systems.
- Define Trigger events either time or file based on the requirements
- Familiar with AWS Services like EC2, S3, Redshift /Spectrum, Glue, Athena, RDS, Lambda, and API gateway;
- Familiar with software DevOps CI/CD tools , such Git, Jenkins, Linux, and Shell Script
- Ability to learn quickly, be organized and detail oriented
- Build of DAG's and Airflow
- Experience in Software Engineering and Development
- Understanding of database schema design
Apply safely
To stay safe in your job search, information on common scams and to get free expert advice, we recommend that you visit SAFERjobs, a non-profit, joint industry and law enforcement organization working to combat job scams.
