Senior Consultant

The ideal candidate will be responsible for developing, optimizing, and maintaining data pipelines and infrastructure while ensuring adherence to data governance and security policies. Responsibilities:

1. Develop tools and processes used to maintain a common, data standard across the Bank.
2. Translate the business requirements into technical requirements.
3. Analyze processes and technologies, contributing to the integration of new solutions.
4. Define and document functional and non-functional user requirements and specifications.
5. Develop source mapping matrix and other key artifacts and documents.
6. Build physical data model from logical data model into data warehouse and data lake.
7. Build data pipelines, ETL/ELT, data control & validation processes using ETL frameworks and data integration tools.
8. Write and optimize complex SQL, Python, Shell script code for data pipelines that leverage relational and non-relational data.
9. Perform unit testing, system integration testing, and user acceptance testing.
10. Deploy machine learning models developed by data scientists into production environment.
11. Provide training and technical support to operations team and end users.
12. Perform performance optimization and maintenance on data warehouse and data lake.
13. Create and maintain technical documentation that is required in supporting solutions.

1. Strong SQL and relational database / data warehouse skills; data analysis experience is needed to be successful in this role.
2. Good understanding of big data infrastructure and platforms; in-depth understanding of big data systems based on Hadoop, with implementation experience being an added advantage (Hive, HBase, Scoop, Spark, etc.).
3. Proficient in writing Spark SQL, Hive SQL programs, and related scripts.
4. Familiar with enterprise-level Linux/Unix operating systems and Shell script programming.
5. Working knowledge of Informatica ETL tooling, Teradata, and Oracle databases.
6. Excellent team spirit and communication skills, strong learning ability and initiative, clear logical thinking, and willingness to accept challenges.