remote
Data Platform Engineer II - TD
Data Engineer
Senior engineer building scalable data pipelines and platforms using Python, SQL, Spark, and AWS services to support enterprise analytics and data science initiatives.
About the role
Key Responsibilities
- Design, develop, and maintain large‑scale data pipelines that ingest, transform, and load data from diverse sources into enterprise data warehouses.
- Leverage Apache Spark and Python to build efficient ETL workflows, ensuring data quality, lineage, and performance.
- Implement and manage data models, schemas, and metadata in AWS data services such as Redshift, S3, and Glue.
- Collaborate with data scientists, analysts, and business stakeholders to understand requirements and deliver actionable data solutions.
- Monitor, troubleshoot, and optimize pipeline performance, applying best practices for scalability and reliability.
Requirements
- 5+ years of experience in data engineering or related roles.
Skills
pythonsqlapache sparkaws