onsite
Data Developer - CMP Techsseract LLP
Software Engineer
Seeking an experienced Data Developer skilled in Python, PySpark, Hadoop, Spark, and Databricks to build and maintain scalable data pipelines, optimize SQL queries, and leverage cloud platforms for enterprise data warehousing solutions.
About the role
Key Responsibilities
- Design, develop, and maintain robust data pipelines using Python, PySpark, and Spark on Databricks.
- Integrate and transform data from Hadoop and relational databases, ensuring high quality and performance.
- Optimize SQL queries and implement efficient data warehousing solutions.
- Collaborate with data engineers and analysts to support data-driven decision making.
- Monitor and troubleshoot production data workflows, applying best practices for scalability and reliability.
Requirements
- 3–5 years of professional experience as a Data Developer or similar role.
- Familiarity with data warehousing concepts and tools.
- Experience with cloud platforms (AWS, Azure, or GCP) is a plus.
Skills
pythonhadoopdatabrickssql