Sr Data Engineer with Kafka - CGI

Role and Resposibilitues: . Candidate must have an agile mindset; An expert in Scaled Agile delivery model, experienced with agile ceremonies such as daily scrums, spring planning, sprint reviews and sprint demos. . Design and implement low latency, high throughput streaming pipelines using Kafka, Flink, and Spark Streaming. . Build and maintain event driven architectures for real time data ingestion and processing. . Develop stateful and stateless stream processing applications using Flink and Spark Structured Streaming. . Collaborate closely with various application teams to define integration points and API specification. . Report progress, test metrics and results to the project stakeholders. . Perform all activities involved in the software testing lifecycle. . Highly effective written and verbal communication skills Required Qualifications: . Candidate must have an agile mindset; An expert in Scaled Agile delivery model, experienced with agile ceremonies such as daily scrums, spring planning, sprint reviews and sprint demos. . Should have 8+ years of hands on experience in data engineering roles . Strong experience in building streaming pipeline . Hands on expertise with Hadoop ecosystem, Kafka, Flink, Spark Streaming and SQL . Scala and Python . Oracle Database, SQL, PL/SQL. . Familiarity with CI/CD tools (Git, Bitbucket, uDeploy, ServiceNow) . Familiarity with CI/CD tools (Git, Bitbucket, uDeploy, ServiceNow) . Soft Skills & Client Facing Capabilities . Strong verbal and written communication skills . Ability to explain complex technical concepts to non technical stakeholders . Proven experience working in client facing or consulting roles . Strong problem solving and analytical thinking . Ability to manage multiple priorities in a fast paced environment . Collaborative mindset with leadership capabilities . Highly effective written and verbal communication skills . Preferred Qualifications: Experience in building enterprise scale data platforms Exposure to cloud based data ecosystems (AWS, Azure, or GCP) Knowledge of data governance, security, and compliance practices Experience mentoring junior team members

Your future duties and responsibilities

Required qualifications to be successful in this role