remote
Senior Data Engineer - Adobe
Data Engineer
Senior Data Engineer driving scalable pipelines and data foundations for Adobe’s Firefly AI products, leveraging Python, Spark, Airflow, and AWS to empower analytics, finance, and model engineering teams.
About the role
Key Responsibilities
- Design, build, and maintain robust data pipelines that support AI, finance, and analytics workloads across Firefly.
- Collaborate with cross‑functional teams (Finance, Credit Metering, NLP, Model Engineering) to translate business requirements into scalable data solutions.
- Implement best practices for data quality, lineage, and governance using Airflow, Spark, and AWS services.
- Optimize performance and cost of data workflows, ensuring high availability and reliability.
- Mentor junior engineers and champion data engineering standards within the organization.
Requirements
- 5+ years of experience in data engineering with a strong focus on large‑scale batch and streaming pipelines.
- Proficiency in Python, SQL, Apache Spark, and Airflow.
- Hands‑on experience with AWS data services (Glue, Redshift, S3, EMR).
- Solid understanding of data modeling, ETL best practices, and data governance.
- Excellent problem‑solving skills and a proactive, ownership‑driven mindset.
Skills
pythonsqlapache sparkairflowaws