remote
Python Developer - Databricks Lead - UST
Software Engineer
Lead Python engineer building scalable backend services and data pipelines on AWS and Databricks, delivering robust REST APIs and multi‑tenant data solutions.
About the role
Key Responsibilities
- Design, develop, and maintain high‑performance backend services using Python and Flask.
- Build and expose RESTful APIs for data integration, leveraging AWS API Gateway and Lambda.
- Develop, schedule, and monitor data pipelines and workloads in Databricks, ensuring data quality and performance.
- Implement multi‑tenant architecture with strict data isolation and efficient resource utilization.
- Integrate observability tools: dashboards, metrics, logging, and alerting to maintain system health.
Requirements
- 4–6 years of professional experience in Python development and AWS cloud services.
- Proficiency with AWS Lambda, S3, API Gateway, and Databricks.
- Strong knowledge of relational databases, especially MySQL, and experience with Flask.
- Hands‑on experience designing scalable, secure, and maintainable REST APIs.
- Excellent problem‑solving skills and a proactive approach to monitoring and performance tuning.
Skills
pythondatabricksmysqlflask