onsite
Senior Software Engineer - Data - BBC
Software Engineer
We're looking for a Software Engineer focused on designing and building scalable technical solutions. This senior role requires 5+ years of relevant experience.
About the role
- Developing high-quality data schemas, code, tests, documentation and scripts; ensuring they are understandable, maintainable, observable and minimise risk.
- Develop shared data schemas and contracts for interoperation with upstream and downstream BBC metadata and search systems
- Participate in the team’s software development methodologies, such as pairing, code and documentation review, and continuous delivery. Learning about new technologies and techniques and assess their applicability and usefulness to our products and our users.
- Help troubleshoot and resolve issues throughout the data life cycle
- Participate in the team's agile planning and delivery processes
- Contribute to engineering best practices, testing, and deployment pipelines
- Demonstrable experience of delivering data-powered applications in production
- Hands-on experience with modern cloud data analysis & engineering (we use SQL, Python, AWS Glue, Apache Iceberg, Apache Parquet, Apache Spark)
- Experience of modern data transformation pipeline tools such as dbt or SQLMesh
- Working experience of data modelling (e.g. Entity-Relationship)
- Experience of managing data quality, for example Great Expectations, AWS Glue Data Quality
- Knowledge of broadcast media metadata and encoding formats
- Experience of next generation data tooling such as DuckDB, Polars etc
Skills
pythonsqlawsapache sparkdbtgreat expectationsagile