onsite
B2B Data Engineer - IWConnect
Data Engineer
Seeking experienced Data Engineers to design and build cloud‑based data pipelines and platforms using Python, PySpark, Airflow, dbt, Databricks, and AWS. Focus on B2B collaboration and future project‑based engagements.
About the role
Key Responsibilities
- Design, develop, and maintain scalable data pipelines in Python and PySpark.
- Orchestrate workflows with Airflow and manage transformations using dbt.
- Deploy and optimize solutions on Databricks and AWS cloud services.
- Collaborate with cross‑functional teams to define data architecture and enable analytics.
- Ensure data quality, performance, and security across all stages.
Requirements
- Proven experience in Python, PySpark, Airflow, dbt, and Databricks.
- Strong SQL skills and familiarity with cloud platforms (AWS, Azure, GCP).
- Hands‑on experience building end‑to‑end ETL processes and data platforms.
- Excellent problem‑solving and communication skills.
- Ability to work independently in a contractor, project‑based environment.
Skills
pythonairflowdbtdatabricksawssql