Job Overview:
Are you a data enthusiast who loves building high-performance pipelines? We are looking for a Data Engineer to be the architect of our data ecosystem. You will be responsible for building the "highways" that transport data from raw sources into actionable insights using the Azure cloud stack.
Key Responsibilities:
- Pipeline Architect: Design and maintain robust ETL/ELT pipelines using Azure Data Factory and Python.
- Data Processing: Build and optimize large-scale data workflows using Azure Databricks and PySpark/SparkSQL.
- Analytics Support: Develop data models and DAX measures to power-up our Power BI dashboards.
- Infrastructure: Manage data warehousing solutions within the Azure ecosystem (Data Lake, Synapse Analytics).
- Quality Control: Implement monitoring frameworks to ensure data integrity, security, and scalability
Requirements:
- Experience: Minimum 1+ years of hands-on experience in Data Engineering.
- Tech Stack (Must-Have):
Expertise in Azure Databricks (PySpark, Delta Lake).
- Proficiency in ETL tools (Azure Data Factory or custom Python pipelines).
- Strong SQL and relational database design skills.
- Experience in Power BI (Data modeling & DAX) Bonus Points If You Have
- Experience with RAG (Retrieval-Augmented Generation) or AI/ML data prep.
- Knowledge of Gen AI or Agentic AI frameworks.
- Background in Agile or DevOps environments.
Pay: RM4,264.59 - RM5,500.00 per month
Work Location: In person