O pozici / o projektu
Původní popisek. Project • The project focuses on the continuous development and modernization of a large-scale streaming data platform.
- ▪The main objective is to evolve existing Apache Flink-based streaming pipelines while executing complex data migrations and platform upgrades.
Key responsibilities include: • Developing and enhancing real-time streaming pipelines using Apache Flink
- ▪Migrating existing Flink jobs using the DataStream API and adapting them to newer platform standards
- ▪Leading and executing the upgrade of the Flink platform to version 2.0
- ▪Designing, optimizing, and maintaining high-throughput, fault-tolerant streaming architectures
- ▪Migrating large-scale datasets from BigQuery (BQ) to Data Cloud Storage (DCS)
- ▪Scaling and automating ongoing data migration processes to support growing data volumes
- ▪Converting datasets from Avro to Parquet format with attention to performance, schema evolution, and storage optimization
- ▪Leveraging AI-powered tools to accelerate migration, validation, and transformation workflows
- ▪Ensuring data quality, integrity, and minimal downtime during migrations
- ▪Collaborating with cross-functional teams and clearly communicating technical concepts to non-technical stakeholders
Detail pracovní nabídky
- ▪Ihned
- ▪Práce plně na dálku
- ▪Flexibilní pracovní doba
Výhody
- ▪Sportovní balíček
- ▪Rozpočet na školení
- ▪Soukromá zdravotní péče
- ▪Mezinárodní projekty