remote
Test Engineer - City People Solutions
QA Engineer
Data‑centric Test Engineer focused on automated data pipeline validation, Power BI semantic model testing, and CI/CD integration using Azure DevOps. Requires expertise in Python, PySpark, Azure Data Factory, and data quality/lineage tools.
About the role
Key Responsibilities
- Design and implement automated data testing frameworks for Azure Data Factory pipelines, Dataflows Gen2, and PySpark/Spark notebooks to validate ingestion and transformation logic.
- Test and verify Power BI semantic models, including DAX calculations and Row‑Level Security (RLS) implementation.
- Enforce data quality rules—completeness, accuracy, uniqueness—and trace data lineage across OneLake, Lakehouse, and Warehouse environments using built‑in tools.
- Integrate data testing suites into Azure DevOps CI/CD pipelines to ensure smooth deployment and continuous quality assurance.
Requirements
- Proficiency in Python and PySpark for data validation scripts.
- Hands‑on experience with Azure Data Factory, Dataflows Gen2, and Azure DevOps.
- Strong knowledge of Power BI model testing, DAX, and RLS.
- Solid understanding of data quality principles and lineage tracking.
- Excellent problem‑solving skills and attention to detail.