Project – the aim you’ll have
Our team works with a British insurance company on proactive cyber insurance products. The Cyber Data Services team is at the core of protecting policyholders from existing and emerging cybersecurity vulnerabilities and threats. The role focuses on developing a proprietary data platform that aggregates, presents, and analyses large datasets. The platform supports new data capabilities such as large-scale data ingestion, robust high-performance APIs, high-frequency event streams, and data quality improvements across the estate. This is an opportunity to have a material impact on products and solutions that help customers understand and reduce cyber risk.
Position – how you’ll contribute
As a Senior Python Software Engineer, you will play a key role in designing, building, and improving data capabilities that strengthen the company’s competitive advantage in cyber data. You’ll work closely with engineering, infrastructure, and analytics stakeholders to develop scalable data services and platform features across Azure and AWS environments.
In this role, you will:
- Design and implement new data capabilities, including large-scale data ingestion, transformation pipelines, robust high-performance APIs, and consumers for high-frequency event streams.
- Contribute to the development of the proprietary data platform and help evolve it towards a data mesh architecture for the enterprise.
- Build solutions using the standard technology stack: Python, Linux via WSL, PostgreSQL, SQL Server, Databricks, and cloud infrastructure spanning Azure and AWS.
- Develop advanced mechanisms for data ingestion, transformation, and mass-parallel orchestration of network IO.
- Model data for operational and analytical purposes in collaboration with your team, other engineering teams, and analytical data customers.
- Work with infrastructure teams to maintain Infrastructure as Code and deliver valuable features for the engineering platform.
- Improve data quality across the estate by defining and acting on indicators such as completeness, accuracy, reliability, and usability.
- Evaluate potential new data sources for specific applications, assessing their completeness, accuracy, and business value.
- Contribute to quality automation in CI/CD processes, optimising for a bug-free release cadence and a positive developer experience.
- Support test automation through platform enhancements and additional automated tests.
- Maintain clear technical documentation, starting with well-documented code and extending to materials for technical and non-technical audiences.
- Participate in a pairing-first development team by sharing expertise, learning from colleagues, and contributing to an open engineering culture.
- Mentor and coach less experienced engineers through design discussions, code revie