Primary Focus: ETL Pipelines & Data Flow Orchestration
Minimum Relevant Experience : 4 years
Key Responsibilities:
Build, optimize, and maintain robust ETL/ELT pipelines across heterogeneous applications and databases.
Manage data streaming, batch processing, and centralized data architecture.
Ensure data consistency, low-latency cross-application data flow, and data warehouse/lake storage optimization.
Requirement:
- Minimum 4 years of relevant experience in Data Engineering, ETL/ELT Development, or Data Integration.
- Strong hands-on experience in Python and SQL.
- Practical experience developing and maintaining ETL/ELT pipelines.
- Experience with at least one major data processing framework such as Apache Spark or PySpark.
- Experience with at least one workflow orchestration tool such as Airflow or Azure Data Factory.
- Exposure to data streaming technologies such as Kafka.
- Experience working with cloud-based Data Warehouse or Data Lake platforms.
- Bachelor's degree in computer science, Information Technology, Data Engineering, Software Engineering, or a related discipline is preferred.