
Senior Data Engineer
AI is analyzing your overall score…
Identifying your key strengths…
Evaluating your skill match against the job requirements…
Assessing your cultural and operational fit
STIWA group
Backend Engineer
June 27, 2026 – Present
Spark_Structured_Streaming_Java
November 19, 2023 – November 19, 2023
In this solution, the issue of creating a table with case-sensitive columns (in the scenario where the table doesn't exist or when writing the table in overwrite mode) in Oracle has been addressed by developing a custom Oracle dialect and registering it.
View ProjectSpark_Java_Stateful_Processing
June 27, 2023 – June 28, 2023
This project presents a distributable solution based on Spark Java, aiming to connect start and end session events together in a stateful manner. The project utilizes `flatMapGroupWithState`functionality which is a powerful feature for stateful stream processing in Spark. It enables you to maintain and update the state across batches.
View ProjectSpark_Java_MostValuableCustomers
June 26, 2023 – June 26, 2023
This Spark Java project serves as a demonstration of Gradle Spark configuration, specifically focusing on utilizing the MemoryStream class as the streaming source.
View ProjectTrending_Topic_Spark_Streaming_Scala
November 1, 2022 – November 4, 2022
This is an End to End solution to read data from streaming source (kafka), extract different topic from data in each time window, calculating Hot Topics using a modified Z-Score Algorithm and storing Final Trend Topics in Postgres SQL Database
View ProjectSpark-Scala-Data-Pipeline
September 1, 2022 – September 2, 2022
An End to End solution to read XML data from FTP server and process and import them into postgres relational database
View ProjectPySpark-AWS-Postgres-ETL
September 1, 2022 – October 4, 2022
An End to End solution to read TSV files from AWS S3 and process and import them into postgres relational database.
View ProjectCultural Fit Analysis
The candidate's projects are primarily personal and highly technical, focusing on data engineering and distributed processing. While this demonstrates strong technical initiative, there is insufficient data to assess collaboration, team dynamics, or broader cultural alignment. The current role as 'Backend Engineer' at STIWA group aligns with the target role, but no details are provided about the company or responsibilities.
Soft Skills & Operational Fit
Insufficient data to assess soft skills or operational fit. The candidate's project descriptions indicate a focus on complex technical challenges and problem-solving.