onsite
Software Engineer II, Data Engineering - Deloitte
Software Engineer
Software Engineer II focused on designing, building, and maintaining scalable data pipelines and backend data platforms across cloud and on‑premises environments, enabling analytics, reporting, and GenAI/LLM use cases.
About the role
Key Responsibilities
- Design, develop, and operate robust data pipelines that ingest, transform, and store large‑scale datasets.
- Implement and maintain backend data systems on cloud platforms (AWS, Azure) and on‑premises infrastructure.
- Collaborate with cross‑functional teams to translate business and technical requirements into scalable data solutions.
- Ensure data quality, governance, and security throughout the data lifecycle.
- Support analytics, reporting, and emerging GenAI/LLM workloads by providing reliable, well‑governed data assets.
Requirements
- 2+ years of professional experience in data engineering or software development.
- Proficiency in Python and SQL for data manipulation and pipeline development.
- Hands‑on experience with Apache Spark or similar distributed processing frameworks.
- Familiarity with cloud services (AWS, Azure) and on‑premises data platforms.
- Strong problem‑solving skills and ability to work collaboratively in a fast‑paced environment.
Skills
pythonsqlapache sparkawsazure