remote
Senior Data Engineer - Polaris I/O
Data Engineer
Senior Data Engineer responsible for designing, building, and scaling data pipelines on AWS using Python, EKS, and PostgreSQL to support analytics and business insights for B2B customers.
About the role
Key Responsibilities
- Design, develop, and maintain robust ETL pipelines in Python to ingest, transform, and load large‑scale B2B data sets.
- Architect and operate data services on AWS, leveraging Amazon EKS, S3, Lambda, and other managed services for high availability and scalability.
- Model, optimize, and manage PostgreSQL databases, ensuring performance, security, and data integrity.
- Containerize data workloads with Docker and orchestrate them via Kubernetes/EKS for reproducible deployments.
- Collaborate with data scientists, product managers, and engineering teams to translate business requirements into reliable data solutions.
Requirements
- 5+ years of professional experience building data pipelines and platforms, primarily with Python.
- Strong hands‑on expertise with AWS services (EKS, S3, RDS/PostgreSQL, IAM, CloudWatch) and infrastructure‑as‑code tools.
- Deep knowledge of relational database design, SQL optimization, and PostgreSQL administration.
- Proficiency with container technologies (Docker) and orchestration (Kubernetes/EKS).
- Experience in CI/CD, monitoring, and troubleshooting data workflows in a production environment.
Skills
pythonawspostgresqldocker