- Kuala Lumpur Kuala Lumpur WP Kuala Lumpur Malaysia
Working Location
Job Description
Responsibilities
Role Summary
A Lead Data Architect / Senior Data Engineering Lead who owns the overall data platform strategy, guides engineering teams, and builds high-performing, cost-efficient data infrastructure to power advanced analytics and reporting.
Core Responsibilities
Drive Platform Architecture: Design and scale the enterprise data platform across Databricks and Microsoft Fabric.
Lead Engineering & Pipelines: Oversee the build of fast, reliable data pipelines and dimensional models.
Lead & Mentor Teams: Guide and upskill data engineers and data modelers in technical best practices.
Bridge Business & Tech: Work with leadership and analysts to turn business goals into actionable data roadmaps.
Governance & Quality: Establish clear standards for data quality, testing, lineage, and documentation.
Optimization & DevOps: Streamline workflows for high performance and low cost using DevOps/CI/CD and FinOps practices.
Key Technical Skills
Platforms: Databricks (Delta Lake, Unity Catalog) & Microsoft Fabric (Lakehouse, OneLake, Data Factory).
Engineering & SQL: Advanced Spark/PySpark, batch/streaming/CDC pipelines, and expert-level SQL query tuning.
Data Modeling: Dimensional modeling (star/snowflake), Data Vault, and metadata-driven frameworks.
Operations: CI/CD automation, DevOps principles, and cost optimization (FinOps).
System Integration: Connecting disparate sources like POS, ERP, cloud systems, and APIs into seamless data flows.
Domain Expertise: Experience with Retail and POS data (or an ability to pick it up quickly).
Important Information
Never provide your bank or credit card details when applying for jobs. Do not transfer any money or complete unrelated online surveys. If you see something suspicious, Report this Job ad.