Azure Data Engineer Databricks

Azure Data Engineer: Data Bricks Location: South Africa: Fully Remote The call is for an experienced Data Engineer to take responsibility for preparing data products and advancing technical thought leadership for the Enterprise to deliver fit-for-purpose data products for consumption by advanced analytics. Provide clean, usable data to whomever may require it.

What will you be responsible for:

1. Design, construct, install, test, and maintain highly scalable data management systems.
2. Ensure systems meet business requirements and industry practices.
3. Build high-performance prototypes and proof of concepts.
4. Research opportunities for data acquisition and new uses for existing data.
5. Develop data set processes for data modeling, mining, and production.
6. Integrate new data management technologies and software engineering tools into existing structures.
7. Create custom software components, specialized UDFs, and analytics applications.
8. Employ a variety of languages and tools, including scripting languages, to marry systems together.
9. Install and update disaster recovery procedures.
10. Recommend ways to improve data reliability, efficiency, and quality.
11. Collaborate with data architects, modelers, and IT team members on project goals.
12. Determine, in conjunction with the Data Architect, what data management systems are appropriate.
13. Obtain information from the Data Scientist to determine which data is needed for analysis.
14. Support the achievement of the business strategy, objectives, and values.
15. Stay abreast of developments in the field of expertise.

Minimum Requirements:

1. Senior National Certificate
2. Advanced Diploma or BSc Degree in Computer Science
3. 5-10 Years experience across multiple data-related disciplines

Technology Stack:

1. Databricks
2. Extract, Transform, and Load Data
3. Databases