Job Description
About the Role
We are looking for a motivated and detail-oriented Data Engineer with 3–4 years of experience in data engineering and analytics solutions. The ideal candidate should have hands-on experience with Microsoft Fabric, strong PySpark skills, and a foundational understanding of Databricks. The candidate should be eager to learn, adaptable to new technologies, and passionate about building scalable data solutions.
Key Responsibilities
- Design, develop, and maintain data pipelines using Microsoft Fabric.
- Build and optimize ETL/ELT processes for ingesting, transforming, and loading data from multiple sources.
- Develop and maintain data transformation workflows using PySpark.
- Work with Lakehouse, Data Warehouse, and Data Factory components within Microsoft Fabric.
- Collaborate with business stakeholders, analysts, and data teams to understand data requirements.
- Ensure data quality, consistency, and reliability across data platforms.
- Monitor and troubleshoot data pipeline performance and resolve issues proactively.
- Support data modeling and reporting requirements for analytics and business intelligence initiatives.
- Participate in code reviews, testing, and deployment activities.
- Stay updated with emerging technologies and best practices in data engineering.
Required Skills
- 3–4 years of experience in Data Engineering or related roles.
- Hands-on experience with Microsoft Fabric (Data Factory, Lakehouse, Data Warehouse, Notebooks, etc.).
- Strong proficiency in PySpark for data processing and transformation.
- Good understanding of ETL/ELT concepts and data pipeline development.
- Experience working with SQL and relational databases.
- Basic understanding of Databricks and Spark ecosystem.
- Familiarity with data lakes and modern cloud-based data architectures.
- Knowledge of data quality, performance tuning, and optimization techniques.
- Experience with version control tools such as Git.
Preferred Skills
- Exposure to Azure Data Services.
- Understanding of Delta Lake concepts.
- Experience with Power BI integration and reporting.
- Knowledge of CI/CD practices for data engineering projects.
- Familiarity with Agile/Scrum methodologies.
Educational Qualifications
- Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.
Desired Candidate Profile
- Strong analytical and problem-solving skills.
- Eagerness to learn and work on new technologies.
- Good communication and stakeholder management skills.
- Self-motivated, proactive, and a strong team player.
- Ability to work in a fast-paced and collaborative environment.
Nice to Have
- Microsoft Fabric certifications.