Hello from RE Partners !
Who We Are: We are a fast growing business and technology consultant company co-founded in 2019. We offer a custom-tailored, white-glove engineering service fit for our clients, because a digital transformation is more than just technology. With a successful track record of being a preferred vendor for Fortune 500 companies and as a trusted partner for some of the industry’s leading companies, our global talent has helped many clients achieve their goals.
The 3 G’s of RE:
“Get Shit Done.”
“Get Over Shit.”
“Give a Shit.”
Senior Data Engineer
This role exists to drive value for our customers and business functions through effective data engineering, modelling, and data transformations by leading the delivery of strategic data solutions whilst setting up resilient data architecture and engineering foundations and supporting junior members of the data engineering team.
Responsible for:
- Leading the design and orchestration of modularized, automated, event-driven data engineering pipelines and data modeling approaches.
- Building in quality by design into data engineering practices, enabling a scalable and flexible data architecture and feature rich dataset to support the wider Data function and the entire business.
- Implementing modern code development and data engineering orchestration strategies to target and streamline our data engineering processes.
- Embedding new data techniques into the business through coaching, training, and providing experiment design oversight to more junior data engineers.
- Working with third party partners and software providers to improve and/or implement new data solutions and processes.
- Being the gatekeeper for customer data, aware of our usage and alignment to data privacy standards, in collaboration with Data Governance to ensure best practice standards are applied/maintained.
Accountable for:
- Working closely with our Lead Data and ML Engineers to drive the adoption of DevOps and modern code development practices across the Data function.
- Collaborating with Quality and Software Engineering and System teams to drive cross-function visibility and reduction of technical debt across the teams.
- Ensuring that our data engineering processes and pipelines are resilient and future-proof.
- Developing a strong knowledge of all data sources and maintaining relationships with data users/processors across the company.
- Being a Senior Data Engineer, supporting more junior data engineering colleagues from a technical skills development perspective.
Essential skills and experience:
- Extensive expertise of RDBMS, Python, Hadoop, SQL and Pyspark.
- GCP experience, including Dataproc and Dataflow
- Hands on Java experience
- Hands on experie