remote
Data Engineer - Obsidian Security
Data Engineer
Data Engineer building scalable data pipelines in AWS, transforming SaaS security telemetry with Python and SQL to enable real‑time threat detection and analytics.
About the role
Key Responsibilities
- Design, develop, and maintain robust data pipelines ingesting telemetry from Microsoft 365, Salesforce, and other SaaS sources.
- Implement ETL processes using Python, SQL, and AWS Glue to transform raw logs into structured, query‑ready datasets.
- Collaborate with data science and security teams to model data for advanced analytics and machine‑learning workloads.
- Optimize pipeline performance and cost on AWS, leveraging services such as S3, Redshift, and Athena.
- Ensure data quality, lineage, and compliance with security and privacy standards.
Requirements
- 3+ years of experience as a Data Engineer or similar role.
- Experience with SaaS telemetry or security data is a plus.
- Excellent problem‑solving skills and ability to work in a fast‑paced, collaborative environment.