onsite
Data Engineer SOC - IBH connect GmbH
Data Engineer
Data Engineer for SOC, responsible for building and maintaining secure data pipelines, integrating threat intelligence feeds, and ensuring real‑time analytics on AWS. Requires strong Python, SQL, and ETL skills with experience in Spark and cloud security.
About the role
Key Responsibilities
- Design, develop, and maintain secure data pipelines for SOC analytics on AWS.
- Integrate threat intelligence feeds and log data from diverse sources into a unified data lake.
- Implement real‑time data processing using Spark and stream processing frameworks.
- Ensure data quality, lineage, and compliance with security standards.
- Collaborate with security analysts to deliver actionable insights and dashboards.
Requirements
- Proven experience as a Data Engineer in a security operations context.
- Strong proficiency in Python, SQL, and ETL development.
- Hands‑on experience with AWS services (S3, Glue, Redshift, Kinesis).
- Familiarity with Spark, Kafka, or similar big‑data technologies.
- Solid understanding of security best practices and data governance.