- Kuala Lumpur Federal Territory Malaysia
Avanade Hiring! Full Time Databricks Machine Learning Lead in Federal Territory - Ricebowl
Share
Save
Working Location
Job Description
Responsibilities
Summary
Our talented Data & AI Practice is made up of globally recognized experts - and there’s room for more analytical and ambitious data professionals. If you’re passionate about helping clients make better data-driven decisions to tackle their most complex business issues, let’s talk. Take your skills to a new level and launch a career where you can truly do what matters.
The Databricks M/L Technical Lead is a senior, hands-on role responsible for the design, development, and delivery of highly scalable, secure, and performant data solutions on the Databricks Lakehouse Platform. It is expected to provide technical leadership to a team of engineers, defining coding standards, implementing architectural patterns, and ensuring the delivery of high-quality data products.
Key Responsibilities
Skills & Experiences
Our talented Data & AI Practice is made up of globally recognized experts - and there’s room for more analytical and ambitious data professionals. If you’re passionate about helping clients make better data-driven decisions to tackle their most complex business issues, let’s talk. Take your skills to a new level and launch a career where you can truly do what matters.
The Databricks M/L Technical Lead is a senior, hands-on role responsible for the design, development, and delivery of highly scalable, secure, and performant data solutions on the Databricks Lakehouse Platform. It is expected to provide technical leadership to a team of engineers, defining coding standards, implementing architectural patterns, and ensuring the delivery of high-quality data products.
Key Responsibilities
- Lead the Design: Define and implement robust data architectures utilizing the Databricks ecosystem, including Delta Lake, Unity Catalog, Machine Learning Models and Databricks Workflows.
- Hands-on Development: Serve as the most senior developer, writing high-quality, production-grade code in PySpark/Scala and SQL for complex batch and streaming ETL/ELT pipelines.
- Performance Optimization: Lead performance tuning and optimization efforts for large-scale Spark jobs, ensuring efficient cluster utilization and cost management
- Standards & Best Practices: Define and enforce technical standards, code quality, testing frameworks (unit, integration), and DataOps/CI/CD pipelines for the engineering team.
Skills & Experiences
- 8+ years of experience in machine learning, data science, or MLOps, with at least 4+ years focused specifically on the Databricks Lakehouse Platform.
- Expert proficiency in Python and PySpark/Scala for large-scale data processing and machine learning.
- Deep understanding and practical experience with Delta Lake architecture and optimization techniques.
- Proven expertise implementing MLOps principles using MLflow (Tracking, Registry, Projects, and Deployment).
Important Information
Never provide your bank or credit card details when applying for jobs. Do not transfer any money or complete unrelated online surveys. If you see something suspicious, Report this Job ad.
Learn More