onsite
Data Engineer - Commvault
Data Engineer
Design, build, and maintain scalable data pipelines and warehouses using Python, SQL, and cloud services to enable analytics and data-driven decision making.
About the role
Key Responsibilities
- Develop, test, and deploy robust ETL pipelines to ingest and transform data from diverse sources.
- Design and optimize data models and warehouses on cloud platforms (e.g., AWS Redshift, Snowflake).
- Implement data orchestration and workflow automation using tools such as Apache Airflow.
- Collaborate with data scientists, analysts, and product teams to understand data requirements and deliver reliable data solutions.
- Monitor pipeline performance, troubleshoot issues, and ensure data quality and security.
Requirements
- 3+ years of experience in data engineering or related roles.
- Proficiency in Python and SQL for data manipulation and scripting.
- Hands‑on experience with cloud services (AWS) and data warehousing technologies.
- Familiarity with big‑data processing frameworks such as Apache Spark.
- Experience with workflow orchestration tools like Airflow and version control (Git).
Skills
pythonsqlawsapache sparkairflow