onsite
(Senior) Full Stack Data Engineer, OP Markets
(Senior) Full Stack Data Engineer, OP Markets
This role involves building real-time transaction data pipelines and collaborating with data engineering teams and business stakeholders. Key responsibilities include creating analytics data products, developing data transfer and reporting methods, and ensuring data quality and reliability. The engineer will also develop software tools for data analytics and integrate controlled datasets.
About the role
Tasks
Build real-time transaction data pipelines
Collaborate with data engineering team and business stakeholders
Create analytics data products for business users
Develop data transfer, storage, reporting, and distribution methods
Develop software tools for data analytics
Ensure data quality and reliability
Integrate and publish controlled datasets
Monitor measure and improve data solution impact
Skills
Apache AirflowAzureDatabricksDevOpsMicrosoft PowerMicrosoft Power BIPandasPanderaPolarsPower BIPydanticPytestPythonRuffSQLSpark