remote
Senior Data Engineer - MindTrilogy IT Solutions Pvt. Ltd
Data Engineer
Senior Data Engineer with 7+ years of experience, specializing in SQL, Python, PySpark, and cloud BI solutions on AWS or Azure, plus strong DevOps/DataOps practices in Agile environments.
About the role
Key Responsibilities
- Design, develop, and maintain scalable data pipelines and ETL processes using SQL, Python, and PySpark.
- Build and optimize cloud‑based BI solutions on AWS or Azure, ensuring high performance and reliability.
- Implement DevOps, DataOps, and DevSecOps practices to automate deployment, monitoring, and security of data workflows.
- Collaborate with cross‑functional teams in Agile sprints to translate business requirements into technical specifications.
- Perform data modeling, data quality checks, and performance tuning to support analytics and reporting needs.
Requirements
- 7+ years of overall experience with at least 4 years focused on data engineering.
- Strong expertise in SQL, Python, and PySpark (4+ years).
- 3+ years of hands‑on experience building cloud BI solutions on AWS or Azure.
- Proven experience with DevOps/DataOps tools and practices in Agile environments.
- Excellent analytical, problem‑solving, and documentation skills.
Skills
sqlpythonawsazureagile