Data Engineer- API
Job details
THIS IS A LONG TERM CONTRACT POSITION WITH ONE OF THE LARGEST, GLOBAL, TECHNOLOGY LEADER . Our large, Fortune client is ranked as one of the best companies to work with, in the world. The client fosters progressive culture, creativity, and a Flexible work environment. They use cutting-edge technologies to keep themselves ahead of the curve. Diversity in all aspects is respected. Integrity, experience, honesty, people, humanity, and passion for excellence are some other adjectives that define this global technology leader. Position Overview Position Overview We are looking for an exceptional data engineer to transform, optimize, test, and maintain architectures for enterprise analytics databases, data apis, as well as optimizing data flow and collection for cross functional teams. The mission of the team is to empower decision makers and the broader data communities through trusted data assets and scalable self-serve analytics. The focus of work will be engineering new data APIs, Tuning data Apis for efficiency and scalability, implementing best practices and create Automated tests for API performance, result validations. Qualifications
- 5+ years in the Data Engineer role
- Data API development experience with efficiency and scalability focus with Python based libraries like Flask/Fast API
- Experience with Snowflake and cost optimizations techniques
- Overall solid programming skills, able to write modular, maintainable code, preferably Python & SQL
- Have experience with workflow management solutions like Airflow
- Have experience on Data transformations tools like DBT
- Built processes supporting data transformation, data structures, metadata, dependency, data quality, and workload management
- Experience working with Git
- Strong analytical, problem solving and interpersonal skills
- Familiar with Scrum
- Maintain/develop data APIs efficiency and scalability, implementing best practises and create Automated tests for API performance, result validations with Python based API technologies such as Flask/Fast API with Snowflake as data source
- Design, implement, test and maintain data pipelines/ new features based on stakeholders with Snowflake, SQL, DBT, Airflow requirements
- Snowflake Query performance optimizations
- Develop/maintain scalable, available, quality assured analytical building blocks/datasets by close coordination with data analysts
- Contribute to Analytics engineering process
- API management
- CI/CD (Jenkins)
- AWS environment, for example S3, Lambda, Glue, Cloud watch
- Experience working with remote teams spread across multiple time-zones
- Strong organizational skills and attention to detail
Apply safely
To stay safe in your job search, information on common scams and to get free expert advice, we recommend that you visit SAFERjobs, a non-profit, joint industry and law enforcement organization working to combat job scams.
