Job Title: Data Engineer (Enterprise Data Lake)
Location: Kuala Lumpur, Malaysia (Onsite)
Key Responsibilities
- Design, build, and deploy scalable data pipelines and workflows within an enterprise data lake environment
- Develop and automate data ingestion and routing processes using Python and Apache NiFi
- Define and manage complex job scheduling and dependencies using DAG-based orchestration tools such as Apache Airflow
- Develop efficient and scalable ETL/ELT processes for data extraction, transformation, and loading
- Work hands-on with the Cloudera platform to support big data processing and maintain system stability
- Monitor, troubleshoot, and optimize data pipelines to improve performance and reduce execution time
- Collaborate with cross-functional teams, business analysts, and stakeholders to understand requirements and deliver technical solutions
Required Skills
- Minimum 3+ years of experience in Data Engineering / Data Management
- Hands-on experience with the Cloudera ecosystem
- Strong proficiency in Python for data processing and automation
- Solid experience building data flows using Apache NiFi
- Experience designing and implementing DAG-based workflows (e.g., Apache Airflow)
- Good understanding of ETL/ELT concepts and big data processing
Interested candidates can send your resumes to *************
Benefits:
Application Question(s):
- Are you legally authorized to work in Malaysia
Work Location: In person