Senior Data Engineer - Showtime Consulting

Key Responsibilities

• Design, develop, and maintain large‑scale data pipelines using Python, SQL, and Spark on AWS and Azure platforms.
• Implement robust ETL processes, ensuring data quality, lineage, and compliance with government security standards.
• Collaborate with data scientists, analysts, and stakeholders to translate business requirements into technical solutions.
• Optimize performance and cost of data workloads through architecture reviews and resource tuning.
• Mentor junior engineers and promote best practices in data engineering and DevOps.

Requirements

• 5+ years of experience in data engineering with a strong background in Python, SQL, and Spark.
• Hands‑on expertise with AWS services (Glue, Redshift, S3, EMR) and Azure Data Factory/Databricks.
• Proven track record building scalable, secure data pipelines for large datasets.
• Experience with data governance, security, and compliance in a government or regulated environment.
• Excellent communication skills and ability to work cross‑functionally in a fast‑paced setting.