Senior Kafka (Real-Time) Architect/Engineer

Senior Kafka (Real-Time) Architect/Engineer £750-£880pd (Inside IR35) 2 days per week in London (Canary Wharf first then City) 6 Month Initial Contract   We are seeking an experienced Senior Kafka (Real-Time) Architect/Engineer responsible for designing and implementing scalable, real-time data processing systems using Apache Kafka. This role involves architecting Kafka clusters, ensuring high availability, and integrating with other data processing tools and platforms. As part of the CTO Data Ingestion Service, you will be instrumental in delivering robust data solutions that meet our clients' evolving needs.   Knowledge & Experience / Qualifications: Proficient understanding of Kafka data pipelines and messaging solutions to support critical business operations and facilitate real-time data processing. Proven experience in monitoring Kafka performance, enhancing decision-making, and boosting operational efficiency. Strong collaboration skills, with the ability to work effectively with development teams to integrate Kafka applications and services. Capability to maintain an architectural library for Kafka deployment models and patterns. Experience assisting developers in maintaining Kafka connectors such as JDBC, MongoDB, and S3 connectors, as well as topics schemas, to streamline data ingestion from databases, NoSQL data stores, and cloud storage, enabling faster data ingestion  Required Skills and Experience: Experience with Apache Kafka and real-time architecture - event-driven frameworks. Strong knowledge of Kafka Streams, Kafka Connect, Spark Streaming, Schema Registry, Flink, and Beam. Cloud platforms experience - such as GCP Pub/Sub. The ability to analyse complex issues and develop effective solutions. Banking background is essential