remote
Senior/Staff Data Engineer Remote - US - BNSF Railway
Data Engineer
Senior/Staff Data Engineer driving large‑scale data pipelines and analytics platforms using Python, Spark, SQL, and AWS services to enable real‑time freight operations and business insights.
About the role
Key Responsibilities
- Design, develop, and maintain high‑performance data pipelines that ingest, transform, and store terabytes of rail‑operation data.
- Implement scalable ETL processes using Apache Spark, Python, and Airflow to support analytics, reporting, and machine‑learning workloads.
- Collaborate with data scientists, product owners, and infrastructure teams to define data models, schemas, and data‑quality standards.
- Leverage AWS services (S3, Redshift, Glue, Lambda) to build secure, cost‑effective data platforms and ensure reliable data delivery.
- Monitor, troubleshoot, and optimize pipeline performance, ensuring low latency and high availability for mission‑critical applications.
Requirements
- 5+ years of professional experience building data pipelines and analytics solutions in a cloud environment.
- Strong proficiency in Python, SQL, and Apache Spark for large‑scale data processing.
- Hands‑on experience with AWS data services (S3, Redshift, Glue, Lambda) and infrastructure‑as‑code tools.
- Demonstrated ability to design robust data models, implement ETL workflows, and ensure data quality and governance.
- Excellent problem‑solving skills, ability to work independently, and a collaborative mindset in a remote team setting.
Skills
pythonsqlapache sparkawsairflow