remote
Senior Data Engineer II - Braze
Data Engineer
Senior Data Engineer responsible for designing, building, and scaling data pipelines on AWS using Python, Spark, Airflow, and Kafka to enable reliable analytics and machine‑learning workflows.
About the role
Key Responsibilities
- Design, develop, and maintain scalable ETL pipelines on AWS using Python, Spark, and Airflow.
- Implement real‑time data ingestion and processing with Kafka and stream processing frameworks.
- Collaborate with data scientists and analysts to provide clean, well‑documented data models and marts using dbt.
- Optimize SQL queries and data warehouse performance for high‑throughput analytics.
- Ensure data quality, reliability, and security through testing, monitoring, and governance practices.
Requirements
- 5+ years of professional experience building data pipelines in a cloud environment (AWS preferred).
- Strong proficiency in Python, SQL, and big‑data technologies such as Apache Spark.
- Hands‑on experience with workflow orchestration tools (e.g., Airflow) and streaming platforms like Kafka.
- Familiarity with data modeling, dbt, and modern data warehouse solutions (Redshift, Snowflake, or BigQuery).
- Excellent problem‑solving skills, ability to work autonomously, and a collaborative mindset.
Skills
pythonsqlapache sparkawskafkadbt