Data Engineer - India
Full time
at Freedom Careers
in
Online
Posted on May 3, 2024
Job details
Opportunities:
- Pay Range from 1800 - 2000 AUD/ Monthly
- Australian time zone
- Full Time Remote Opportunity
- Opportunity To learn and Grow with Australia’s No.1 Company
About the Role
We are searching for a talented and passionate Data Engineer to join our growing Data team. In this role, you will be responsible for designing, building, and maintaining scalable data pipelines to ingest, transform, and load data from various sources to support our data science and analytics efforts. You will play a key role in ensuring the quality, availability, and security of our data infrastructure. Responsibilities:- Design, develop, and implement data pipelines using technologies like Apache Spark, Airflow, or similar tools.
- Extract, transform, and load (ETL) data from various sources (databases, APIs, log files, etc.)
- Cleanse, validate, and ensure the quality of data throughout the processing pipeline.
- Develop and maintain data models for efficient storage and retrieval of data.
- Automate data processing workflows to ensure efficiency and reliability.
- Monitor data pipelines and troubleshoot any issues that may arise.
- Collaborate with Data Scientists, Analysts, and other engineers to understand data needs and design solutions.
- Stay up-to-date with the latest trends and technologies in data engineering.
- Document code, workflows, and data models for maintainability.
- Bachelor's degree in Computer Science, Information Technology, or a related field (or equivalent experience).
- Minimum of 3 years of experience as a Junior Data Engineer or similar role.
- Strong experience with SQL and scripting languages (Python, Scala, etc.).
- Experience with distributed data processing frameworks (e.g., Apache Spark) is a plus.
- Familiarity with cloud platforms (e.g., AWS, GCP, Azure) is a plus.
- Experience with data warehousing concepts (e.g., Data Lakes, Data Warehouses) is a plus.
- Excellent problem-solving and analytical skills.
- Strong communication and collaboration skills.
- Ability to work independently and as part of a team.
- Technical Requirements
- Windows 10 and above operating system or MacOS 13+
- 256GB Storage space - minimum
- 8GB RAM - minimum
- Dual Core CPU - minimum
- Camera: HD Webcam (720p)
- Headset: Noise canceling (preferably)
- Internet Speed: 50 Mbps - minimum
Apply safely
To stay safe in your job search, information on common scams and to get free expert advice, we recommend that you visit SAFERjobs, a non-profit, joint industry and law enforcement organization working to combat job scams.