remote
Databricks Engineer - Hilton Grand Vacations
Software Engineer
Design, build, and maintain scalable data pipelines and lakehouse architectures on the Databricks platform, blending data engineering and analytics to deliver governed data assets and actionable insights.
About the role
Key Responsibilities
- Architect and develop end‑to‑end data pipelines using Databricks, Spark, and Python to ingest, transform, and store large volumes of structured and unstructured data.
- Implement and maintain a data lakehouse architecture, ensuring data quality, lineage, and governance across the organization.
- Collaborate with data scientists and business analysts to create advanced analytics, reporting, and visualization solutions that drive actionable insights.
- Optimize performance and cost of Databricks workloads through tuning, caching, and resource management.
- Document data models, pipeline logic, and best practices for future reference and compliance.
Requirements
- Proven experience with Databricks, Apache Spark, and Python for data engineering tasks.
- Strong SQL skills and familiarity with data lakehouse concepts.
- Experience designing scalable, maintainable data pipelines and implementing data governance.
- Excellent problem‑solving skills and ability to work collaboratively in a fast‑paced environment.
Skills
databricksapache sparkpythonsql