onsite
Databricks Dashboard Engineer - Apex Systems
Software Engineer
Senior engineer responsible for building advanced marketing analytics, automated reporting, and interactive dashboards in Databricks using PySpark, Python data‑science libraries, and SQL, enabling business users to query data via Genie chat.
About the role
Key Responsibilities
- Design and develop scalable data pipelines in Databricks using PySpark and SQL to ingest and transform channel marketing and contact data.
- Create and maintain automated reporting solutions and advanced analytics models with Python data‑science libraries (pandas, scikit‑learn, etc.).
- Build interactive, user‑friendly dashboards that integrate with Genie to allow business users to "chat with their data" for self‑service insights.
- Collaborate with marketing, product, and engineering teams to define metrics, ensure data quality, and drive data‑driven decision making.
- Optimize performance of queries and visualizations, and implement best practices for data governance and security.
Requirements
- 5+ years of experience building data pipelines and analytics solutions on Databricks or similar Spark platforms.
- Strong proficiency in PySpark, Python, and SQL for data manipulation and modeling.
- Hands‑on experience creating dashboards and visualizations using tools such as Tableau, Power BI, or custom web frameworks.
- Background in marketing analytics or related domains, with ability to translate business questions into technical solutions.
- Excellent problem‑solving skills and ability to work cross‑functionally in a fast‑paced environment.
Skills
databrickspythonsqlmachine learning