Lead Data Engineer Azure - 3pillarglobal

3Pillar is an AI transformation partner on a mission to help enterprises build the AI-native products and intelligent agents that will define the next era of business. With teams across North America, Europe, Latin America, and Asia, we work with the most ambitious companies in financial services, healthcare, media, and technology — helping them move faster, modernize boldly, and compete on their own terms. Our HelixAI platform and Helix Pods delivery model put our engineers at the center of real agentic transformation — doing work that is open, portable, and built to last. We are building the future of enterprise AI.

Lead, Data Engineer

Embark on an exciting journey into the realm of software product development with 3Pillar! We extend an invitation for you to join our team and gear up for a thrilling adventure. At 3Pillar, our focus is on leveraging cutting-edge technologies that revolutionize industries by enabling data-driven decision-making. As a Lead, Data Engineering, you will hold a crucial position within our dynamic team, actively contributing to thrilling projects that reshape data analytics for our clients, providing them with a competitive advantage in their respective industries.

If your passion for data engineering solutions that make a real-world impact, consider this your pass to the captivating world of Data Science and Engineering! 🌍🔥

Key Responsibilities

Understand client requirements and lead the creation of robust data platforms leveraging Data Lakehouse architectures, serving as the primary subject matter expert for the Azure data ecosystem (Microsoft Fabric, Azure SQL, and Power BI).

Design and implement scalable data models, ETL/ELT pipelines, and analytics layers using modern cloud ecosystems.

Architect Microsoft Fabric reporting solutions, establishing medallion layering, managing capacity planning, ensuring freshness governance, and configuring CDC/mirroring from Azure SQL into Fabric.

Enforce strict data-layer segregation ensuring PII is excluded by construction, maintaining multi-tenant isolation within the analytics layer, and strictly adhering to 10+ year regulated data retention policies.

Lead complex migration efforts off legacy systems (e.g., AirTable, Smartsheet) to Microsoft Fabric, effectively managing mid-program form and rule drift, and establishing reliable, per-client export channels.

Lead end-to-end analytics projects — from requirement gathering to deployment.

Mentor junior team members, perform code reviews, and ensure adherence to quality standards. Work closely with cross-functional teams (engineering, product, business) to align data strategy with business goals.

Develop and optimize complex SQL queries, Power BI semantic models, dashboards, and reports (transitioning from legacy LookML/BigQuery paradigms).

Troubleshoot performance bottlenecks, data inconsistencies, and integration challenges.

Sta