onsite
Junior Data Software Engineer
Software Engineer
Junior Data & Software Engineer focused on cloud data pipelines, leveraging AWS, Azure, Apache Spark, and DBT to design, build, and optimize data partitioning strategies for scalable analytics.
About the role
Key Responsibilities
- Develop and maintain data pipelines using Apache Spark on AWS and Azure environments.
- Implement data partitioning techniques to improve query performance and storage efficiency.
- Collaborate with data analysts to translate business requirements into scalable ETL solutions.
- Utilize DBT for data transformation, version control, and documentation.
- Monitor pipeline health, troubleshoot issues, and optimize resource usage.
Requirements
- Strong foundation in SQL and Python for data manipulation.
- Experience with cloud services (AWS, Azure) and Spark cluster management.
- Familiarity with DBT and modern data modeling practices.
- Knowledge of data partitioning strategies and performance tuning.
- Excellent problem‑solving skills and a collaborative mindset.
Skills
awsapache sparkazuredbt