remote
Data Engineer - UST
Data Engineer
Design, develop, and maintain scalable data pipelines and warehouses using Python, SQL, and cloud services, enabling reliable analytics and real‑time data processing for enterprise solutions.
About the role
Key Responsibilities
- Design, build, and optimize end‑to‑end data pipelines for batch and streaming workloads.
- Develop and maintain data models, warehouses, and lakes on AWS services such as Redshift, S3, and Glue.
- Implement ETL processes using Python, SQL, and Apache Spark to ensure data quality and performance.
- Integrate real‑time data streams with Apache Kafka and process them for downstream analytics.
- Collaborate with data scientists, analysts, and product teams to understand requirements and deliver reliable data solutions.
Requirements
- 3+ years of hands‑on experience in data engineering, building pipelines and data warehouses.
- Proficiency in Python and SQL for data manipulation and transformation.
- Experience with cloud platforms, preferably AWS, and related services (Redshift, S3, Glue, Lambda).
- Strong knowledge of big‑data processing frameworks such as Apache Spark and streaming platforms like Kafka.
- Solid understanding of data modeling, ETL best practices, and performance tuning.
Skills
pythonsqlawsapache sparkkafka