PERSOL Hiring! Full Time Information Technology Consultant (Data Engineer (Cloudera to AWS Migration)) in Central Region (Singapore) - Ricebowl

• Design, develop, and maintain scalable ETL processes and data pipelines using Python, SQL, and PySpark.
• Lead and support migration of data workloads, datasets, and processing frameworks from Cloudera/Hadoop environments to AWS.
• Build and optimize cloud-native data solutions leveraging AWS services such as S3, Glue, EMR, Athena, and Redshift.
• Develop robust data ingestion, transformation, and integration frameworks to support enterprise analytics and reporting needs.
• Monitor and improve data pipeline performance, reliability, and scalability across on-premises and cloud environments.
• Ensure data quality, governance, security, and compliance standards are implemented throughout the data lifecycle.
• Collaborate with data architects, business stakeholders, analysts, and engineering teams to translate business requirements into technical solutions.
• Implement data orchestration, automation, and operational best practices to improve platform efficiency and supportability.
• Support production deployments, troubleshooting, monitoring, and continuous improvement initiatives.
• • 5+ years of experience in Data Engineering, Data Warehousing, or Big Data technologies.
  • Strong programming expertise in Python, SQL, and PySpark .
  • Hands-on experience with the Hadoop/Cloudera ecosystem , including:
  • • HDFS
    • Hive
    • Impala
    • Spark
    • Cloudera Data Platform (CDP) preferred
  • Strong knowledge of AWS Data Services including:
  • • Amazon S3
    • AWS Glue
    • EMR
    • Athena
    • Redshift
  • Proven experience migrating data platforms and workloads from Cloudera/Hadoop to AWS.
  • Extensive experience in ETL development, data integration, and large-scale data pipeline implementation.
  • Strong understanding of data processing, performance tuning, and optimization techniques.
  • Experience working in Agile delivery environments.

• Preferred Skills

• • Data Modeling and Data Architecture concepts.
  • Apache Airflow for workflow orchestration.
  • DevOps and CI/CD pipeline implementation.
  • Banking and Financial Services domain experience.
  • Experience with cloud migration, modernization, and data transformation initiatives.

PERSOL Singapore Pte Ltd • RCB No. 200007268E • EA License No. 01C4394

GOREF: 16942