Auxo Talent Hiring! Full Time Big Data Platform Engineer in Federal Territory - Ricebowl

Job Overview

We are looking for a Big Data Platform Engineer to support a large-scale banking technology project in Malaysia. The ideal candidate should have hands-on experience managing Cloudera Hadoop environments, with strong capabilities in platform operations, monitoring, troubleshooting, and system support within enterprise environments.

This role will be responsible for supporting daily platform operations, assisting with patching and upgrade activities, and participating in migration initiatives across critical production environments.

Key Responsibilities

• Monitor Hadoop cluster performance, platform health, and service availability
• Support incident management activities and coordinate vendor log collection for Cloudera-related issues
• Perform application start/stop activities and implement configuration changes based on operational requirements
• Collaborate with Infrastructure, Storage, Network, and Compute teams to ensure smooth platform operations
• Assist in troubleshooting job failures, queue management, and cluster resource allocation
• Support patching activities, minor platform upgrades, and NiFi template migration tasks
• Participate in backup and recovery operations for critical business datasets
• Manage user access requests involving Kerberos, Ranger, and LDAP authentication
• Assist with Cloudera version upgrades and hotfix deployment activities under senior team guidance
• Support Disaster Recovery (DR) exercises and synchronization activities between Production and DR environments
• Monitor platform performance using Cloudera Manager, Grafana, and ELK monitoring dashboards

Requirements

• Minimum 3+ years of experience supporting Big Data / Hadoop ecosystem technologies, including: HDFS, YARN, Hive, Spark, Oozie
• Hands-on experience with Cloudera Manager administration and support tools
• Good Linux administration and shell scripting knowledge
• Familiarity with Kerberos authentication, Ranger security policies, and LDAP user access management
• Understanding of patch management and platform upgrade processes
• Strong troubleshooting, log analysis, and communication skills

Preferred Skills

• Exposure to Python or Ansible scripting for automation
• Experience supporting CI/CD-based platform operations
• Familiarity with Hadoop deployments on AWS or Azure cloud environments
• Experience supporting banking or financial services environments is an added advantage