onsite
Big Data Analyst - EMOS Software GmbH
Data Analyst
Analyze and transform large datasets using SQL, Python, and Spark to deliver actionable insights and support data-driven decision making.
About the role
Key Responsibilities
- Design, develop, and maintain scalable data pipelines for ingesting and processing terabyte-scale datasets.
- Perform complex SQL queries and data transformations using Python and Spark to extract insights.
- Collaborate with data scientists and business stakeholders to define data models and reporting requirements.
- Optimize query performance and ensure data quality through rigorous testing and monitoring.
- Document data architecture, processes, and best practices for future reference.
Requirements
- Proven experience with Big Data technologies such as Hadoop, Spark, and Hive.
- Strong SQL skills and familiarity with relational and NoSQL databases.
- Proficiency in Python for data manipulation and automation.
- Experience with data warehousing concepts and ETL processes.
- Excellent analytical, problem‑solving, and communication skills.
Skills
sqlpythonapache sparkhadoop