2–4 years of data engineering or backend development experience Familiarity with Agile delivery
Working knowledge of SQL and Java or Scala
Basic experience developing batch or streaming pipelines using Apache Spark, Apache Flink or Apache Kafka
Familiarity with containerised deployment, Kubernetes and S3-compatible object storage
Experience implementing mappings, transformations, validation checks and scheduled workflows, and supporting pipeline monitoring and defect resolution under guidance
Preferred
Familiarity with the SAFe framework
Familiarity with Apache Kafka, Apache Spark, Apache Flink or comparable processing technologies, and
MinIO or equivalent S3-compatible object storage
Familiarity with relational databases, Git, CI/CD, Docker and automated testing
Equivalent Technologies : Apache Spark or equivalent data-processing frameworks; Apache Airflow or equivalent workfloworchestration tools; other S3-compatible object-storage platforms