Role positioning: A hands-on Data Platform Technical Lead who can steer vendor delivery in normal operations while retaining the technical capability to personally troubleshoot and fix urgent production issues. The candidate must combine Databricks and data-engineering depth with vendor management, technical review, incident leadership and stakeholder coordination. Part Workload Required Knowledge Required Skills / Capability
1. Support SHIELD Sundown | 40%
- Support the technical planning and execution required for the SHIELD sundown.
- Identify affected pipelines, jobs, tables, integrations, data products, consumers and operational dependencies.
- Support the transition, migration or controlled decommissioning of the relevant SHIELD components.
- Coordinate with internal teams, vendors, platform teams, markets and other stakeholders to close technical dependencies.
- Troubleshoot transition issues and validate continuity of required data flows.
- Support the removal of obsolete components only after dependencies and impacts have been validated.
- Maintain clear technical status, risks, decisions and open actions throughout the sundown.
- Essential role profile: A hands-on Data Platform Technical Lead who can steer vendor delivery in normal operations while retaining the technical capability to personally troubleshoot and fix urgent production issues. The candidate must combine Databricks and data-engineering depth with vendor management, technical review.
2. Lead Silver & Gold Data Engineering Delivery, Vendor Steering & Technical Support | 30%
- Steer Tiger Analytics and other delivery partners to perform day-to-day Silver and Gold development, fixes, enhancements and support activities.
- Translate operational issues and stakeholder needs into clear technical work items, priorities, acceptance criteria and delivery expectations.
- Review proposed solutions, designs, pull requests, code changes, test evidence and deployment readiness before production release.
- Run technical checkpoints, challenge vendor recommendations where required, and provide clear technical direction to developers.
- Coordinate releases, operational changes, incident fixes and post-deployment validation with internal teams, vendors and stakeholders.
- Monitor vendor progress, remove technical blockers and ensure issues are followed through to resolution.
- Provide internal technical support for complex SHIELD, Silver, Gold and market-related data issues.
- In urgent or critical situations, work hands-on in Databricks and the codebase to investigate failures, implement or correct code, fix bugs, execute required data corrections, and validate recovery.
- Maintain sufficient hands-on technical depth to avoid dependency on vendors during high-priority incidents.
3. Production Pipeline Troubleshooting & Data Issue Resolution | 15%
- Investigate failed, delayed or abnormal data-processing jobs and data-quality issues across the end-to-end pipeline.
- Trace upstream and downstream dependencies across source, Silver and Gold layers.
- Perform root-cause analysis, impact assessment and data reconciliation.
- Troubleshoot notebooks, workflows, transformation logic and refresh processes.
- Define the appropriate corrective action, whether vendor-delivered, operational workaround or direct technical fix.
- Validate data and pipeline behavior after correction and monitor for recurrence.
- Implement hands-on fixes directly when urgency, business impact or vendor availability requires immediate intervention.
4. Data Connectivity & Pipeline Health | 12%
- Manage Aecrosoft pipeline(s) and ensure healthy connectivity for SWT and VX.
- Maintain data integration and connectivity involving CFT and eXtollo components.
- Monitor data-source connections and overall pipeline health.
- Troubleshoot source-connection, integration and connectivity-related pipeline failures.
- Assess the impact of connectivity incidents on downstream Silver and Gold processing.
- Coordinate resolution with source-system, platform, infrastructure, vendor and support teams.
- Identify recurring connectivity risks and drive sustainable fixes rather than repeated workarounds.
5. HMS -> Unity Catalog Migration & Decommissioning (Minor Responsibility) | 1.5%
- Support only the remaining HMS-to-Unity-Catalog migration and decommissioning work as required.
- Identify and resolve residual HMS references or dependencies.
- Troubleshoot remaining HMS-versus-Unity-Catalog issues.
- Support final technical validation and closure activities.
- Treat this as a minor, transitional responsibility rather than a core ongoing role component.
6. OpenMeta Data Maintenance | 1.5%
- Maintain OpenMeta Data required for SHIELD data-platform processing and discoverability.
- Keep metadata, descriptions and related mappings aligned with current tables, columns and platform changes.
- Validate metadata updates against catalog and data-platform structures.
- Troubleshoot metadata-related processing or synchronization issues.
- Coordinate metadata inputs and updates with Silver/Gold engineering and relevant governance stakeholders.
- Maintain the associated operational process and technical guidance.
Pay: RM4,200.00 - RM14,000.00 per month
Work Location: In person