Mandatory
2–4 years of data engineering or backend development experience
Familiarity with Agile delivery
Working knowledge of SQL and Java or Scala
Basic experience developing batch or streaming pipelines using Apache Spark, Apache Flink or Apache Kafka
Familiarity with containerised deployment, Kubernetes and S3-compatible object storage
Experience implementing mappings, transformations, validation checks and scheduled workflows, and supporting pipeline monitoring and defect resolution under guidance
Preferred
Familiarity with the SAFe framework
Familiarity with Apache Kafka, Apache Spark, Apache Flink or comparable processing technologies, and
MinIO or equivalent S3-compatible object storage
Familiarity with relational databases, Git, CI/CD, Docker and automated testing
Equivalent Technologies
Apache Spark or equivalent data-processing frameworks; Apache Airflow or equivalent workflow orchestration tools; other S3-compatible object-storage platform
Established in September 2018 by 3 former senior IT executives, formerly veterans from large multi-national companies, with several decades of business experience in delivering large scale and complex IT solutions and integrations, Applications development, and top quality services.
Our Key Focus:
- Industry Specific Solutions and Advanced Services (BSFI, Healthcare, Manufacturing and Public Sector)
- Niche Enterprise Business Solutions – where we could demonstrate our core skills in seamlessly integrating homogeneous hardware products with software applications
- Advanced IT Professional services - Digital Transformation, Data & Analytics, AI, Cloud Migration Services