onsite
QA Engineer - Sagacity
QA Engineer
QA Engineer responsible for designing and executing test programs for Databricks Lakehouse pipelines, gold‑layer views, and analytics datasets, ensuring data accuracy, completeness, and readiness for marketing, billing, credit and debt applications across multiple industries.
About the role
Key Responsibilities
- Design, implement, and maintain structured test suites for Databricks Lakehouse pipelines, gold‑layer views, and downstream analytics datasets using the internal SPHERE platform.
- Collaborate closely with Data Engineers, Platform Engineers, UAT teams, and client stakeholders to define test criteria, acceptance thresholds, and data quality metrics.
- Execute automated and manual test runs, interpret results, triage failures, and drive root‑cause analysis to resolve data quality issues.
- Develop and maintain test data, SQL queries, and Python scripts to validate data transformations, completeness, and consistency across the platform.
- Participate in Agile ceremonies, provide status updates, and contribute to continuous improvement of QA processes and tooling.
Requirements
- Strong experience with Databricks or similar Lakehouse environments and SQL‑based data validation.
- Proficiency in Python for test automation and data manipulation.
- Hands‑on experience designing and executing test programs for ETL/ELT pipelines and data warehouses.
- Familiarity with QA tools and platforms (e.g., internal test frameworks, CI/CD integration).
- Excellent analytical, problem‑solving, and communication skills, with the ability to work cross‑functionally in fast‑paced, multi‑industry projects.
Skills
databrickssqlpython