remote
Senior Data Engineer - Capnexus
Data Engineer
Senior Data Engineer leading AWS-based analytics and DataOps initiatives, architecting scalable data pipelines, optimizing performance, and driving data-driven insights with Python and SQL.
About the role
Key Responsibilities
- Design, build, and maintain scalable data pipelines on AWS (Glue, Redshift, S3, Lambda) to support analytics workloads.
- Implement DataOps practices, including CI/CD, automated testing, and monitoring for data quality and pipeline reliability.
- Collaborate with data scientists and business analysts to translate requirements into efficient data models and transformations.
- Optimize query performance and storage costs using best practices in Redshift, Athena, and Snowflake.
- Document architecture, processes, and troubleshooting guides for cross‑team use.
Requirements
- 5+ years of experience in data engineering with a strong focus on AWS services.
- Proficiency in Python, SQL, and ETL tooling (Airflow, dbt).
- Hands‑on experience with DataOps concepts: version control, CI/CD pipelines, and automated testing.
- Deep understanding of data modeling, lakehouse architecture, and performance tuning.
- Excellent communication skills and ability to mentor junior engineers.
Skills
awsanalyticspythonsql