remote
Mid-Level Data Engineer - Vantage Data Centers
Data Engineer
Mid‑level Data Engineer responsible for designing, building, and maintaining scalable data pipelines on cloud platforms, leveraging Python, SQL, and modern ETL tools.
About the role
Key Responsibilities
- Design, develop, and maintain robust data pipelines to ingest, transform, and load large‑scale datasets.
- Implement and optimize ETL processes using Python, SQL, and workflow orchestration tools such as Apache Airflow.
- Collaborate with data scientists, analysts, and infrastructure teams to ensure data quality, reliability, and availability.
- Manage and monitor cloud data services on AWS, including S3, Redshift, and Snowflake, ensuring cost‑effective performance.
- Automate data validation, testing, and documentation to support continuous integration and delivery.
Requirements
- 2–4 years of hands‑on experience building data pipelines in a cloud environment.
- Proficiency in Python programming and advanced SQL query writing.
- Experience with ETL/ELT tools and orchestration platforms such as Apache Airflow.
- Solid understanding of AWS services (S3, EC2, Lambda, Redshift) and data warehousing solutions like Snowflake.
- Strong problem‑solving skills, ability to work independently, and effective communication within cross‑functional teams.
Skills
pythonsqlawssnowflake