Job Summary
We are looking for an experienced Data and Reporting Engineer wh to join our data team and support the development, enhancement, and maintenance of data platforms and pipelines. The role will be responsible for translating business requirements into technical solutions, developing and optimizing ETL processes using Databricks, Python, and Azure Data Factory (ADF), and supporting day-to-day BAU activities.
The successful candidate will also prepare technical documentation, monitor data processes, troubleshoot issues, provide regular reporting and progress updates, and work closely with users and technical teams to ensure the reliability and performance of the data platform.
Requirements
- 2+ years of experience in the IT industry
- 2+ years of hands-on experience as an ETL Developer
- Strong experience with Databricks, Python (mandatory), and Azure Data Factory (ADF)
- Experience with OSD, Data Warehouse (DWH), Spark SQL, and Stored Procedures
- Strong proficiency in SQL and database development
- Good programming knowledge, particularly in Python
- Experience with data processing frameworks such as Apache Spark and Hadoop is an advantage
- Experience with Informatica or other ETL tools is an advantage
- Good analytical and problem-solving skills
- Ability to work independently, manage priorities, and deliver tasks within agreed timelines
- Strong teamwork, communication, and collaboration skills
Responsibilities
- Understand, analyse, and translate users’ requirements into effective technical solutions
- Perform program development, system design, and redesign, with a focus on functionality, scalability, and performance
- Develop, maintain, and enhance ETL/data pipelines using Databricks, Python, ADF, and related technologies
- Prepare clear and comprehensive technical specifications and documentation
- Perform SQL development, data transformation, and data processing activities
- Deliver development tasks and project deliverables within agreed timelines
- Independently manage and follow up on data platform BAU tasks, ensuring timely resolution and minimal disruption to operations
- Monitor and support data pipelines and related processes to ensure data accuracy, availability, and reliability
- Prepare and provide regular status reports, progress updates, and issue/escalation reports to relevant stakeholders
- Work closely with users, technical teams, and other stakeholders to troubleshoot issues and support ongoing data platform activities
- Identify opportunities to improve data processing efficiency, system performance, and operational processes
- Perform other related assignments as required
Pay: From RM6,000.00 per month
Benefits:
Application Question(s):
- Will you require sponsorship to work in Malaysia?
- How many years of relevant experience do you have on the applied role?
- How many days is your notice period?
- How much is your expected salary?
- Are you open working on contract for 1year, extendable?
Language:
Work Location: In person