Beyondsoft Hiring! Full Time Data Engineer in - Ricebowl

What you'll be doing

1. Develop, maintain and optimise data pipelines using Python, PySpark and SQL across Cloudera, Snowflake and Databricks platforms.
2. Perform data extraction, cleansing, transformation and loading (ETL) using Informatica and other data integration tools.
3. Support batch data processing and enterprise data integration to ensure data accuracy, quality and consistency.
4. Monitor, troubleshoot and resolve data pipeline failures, performance bottlenecks and data discrepancies.
5. Collaborate with Senior Data Engineers and reporting teams to deliver reliable datasets for business analytics and reporting.

Requirements

• Bachelor's degree in Computer Science, IT, Data Engineering or related disciplines.
• Minimum 3 years of experience in Data Engineering, ETL Development or Data Integration.
• Strong hands-on skills in Python, PySpark and SQL.
• Practical experience with Informatica and ETL/ELT development.
• Experience with at least one of the following platforms: Cloudera, Snowflake or Databricks.
• Good understanding of data pipelines, batch processing, data transformation and data quality management.
• Strong analytical, troubleshooting and problem-solving skills.