remote
Data Pipeline Engineering Specialist Cybersecurity - Morgan Stanley
Security Engineer
Design, build, and operate secure data pipelines that ingest and transform cyber event data for analytics platforms, leveraging Python, Kafka, Spark, and AWS in a hybrid environment.
About the role
Key Responsibilities
- Architect and implement scalable, fault‑tolerant data pipelines to ingest real‑time cyber event streams.
- Develop ETL processes using Python, Apache Spark, and SQL to cleanse, enrich, and store security data.
- Integrate messaging systems such as Apache Kafka and cloud services (AWS S3, Kinesis) for reliable data flow.
- Collaborate with security analysts and engineering teams to define data models and ensure pipelines meet monitoring and analytics requirements.
- Implement security best practices, including data encryption, access controls, and audit logging throughout the pipeline lifecycle.
Requirements
- 5+ years of experience building data pipelines in a security or cyber‑risk context.
- Proficiency in Python, SQL, and big‑data frameworks (Spark, Kafka).
- Hands‑on experience with AWS services (S3, EC2, IAM, Kinesis) and infrastructure‑as‑code tools.
- Strong understanding of cybersecurity concepts, threat data formats, and security analytics workflows.
- Ability to troubleshoot complex data flow issues and optimize performance at scale.
Skills
pythonapache sparksqlaws