全职 Senior Data Engineer 工作, 薪水 up to MYR 10,000, Tech-Matrix Federal Territory 公司招聘中 - Ricebowl

Key Responsibilities

• Design, develop, and maintain scalable data pipelines using Azure data services.
• Build and optimize ETL/ELT processes using PySpark.
• Develop and maintain real-time data streaming solutions using Apache Kafka.
• Work with Azure Databricks, Azure Data Factory (ADF), and Azure Synapse Analytics.
• Integrate data from multiple structured and unstructured data sources.
• Optimize data processing jobs for performance, scalability, and reliability.
• Collaborate with data scientists, analysts, architects, and business stakeholders to deliver data-driven solutions.
• Ensure data quality, governance, security, and compliance across the data platform.
• Monitor, troubleshoot, and resolve production issues related to data pipelines.
• Participate in code reviews and follow DevOps and CI/CD best practices.

Required Skills

• 8+ years of experience as a Data Engineer or Big Data Engineer.
• Strong hands-on experience with Microsoft Azure.
• Expertise in PySpark.
• Strong experience with Apache Kafka.
• Experience with Azure Databricks.
• Experience with Azure Data Factory (ADF).
• Experience with Azure Synapse Analytics.
• Strong SQL and Python programming skills.
• Experience with data warehousing concepts and ETL/ELT development.
• Knowledge of distributed data processing and big data technologies.
• Familiarity with Git, Azure DevOps, and CI/CD pipelines.

Pay: RM9,000.00 - RM10,000.00 per month

Work Location: In person