About the Role
Epic Games is looking for a Senior Staff Software Engineer to join our Analytics and Insights team. In this role, you will be instrumental in creating and maintaining the data platforms and pipelines that power data-driven decisions across Epic. You will work closely with other engineers, data scientists, and analysts to build scalable, reliable, and secure data solutions.
What You'll Do
- Lead the design and implementation of large-scale data processing systems and pipelines using technologies like Scala, Spark, and Flink.
- Architect and manage our data warehousing and data lake solutions on AWS, ensuring high performance, reliability, and cost-effectiveness.
- Develop and optimize ETL/ELT processes for ingesting, transforming, and loading data from various sources into our analytics platforms.
- Collaborate with cross-functional teams to understand data requirements and deliver robust data solutions that meet business needs.
- Implement and enforce best practices for data quality, data governance, and data security, ensuring compliance with privacy regulations.
- Mentor junior engineers and contribute to the overall technical growth of the team.
- Evaluate and introduce new technologies and tools to improve our data infrastructure and capabilities.
- Participate in on-call rotations to support critical data systems.
What We're Looking For
- 8+ years of experience in software engineering with a strong focus on big data technologies and distributed systems.
- Expertise in programming languages such as Scala.
- Extensive experience with Apache Spark and/or Apache Flink for real-time and batch data processing.
- Deep understanding and hands-on experience with AWS cloud services related to data (e.g., S3, EMR, Kinesis, Glue, Redshift).
- Proficiency in SQL and experience with modern data warehousing solutions (e.g., Snowflake).
- Demonstrated ability to design, build, and maintain complex data pipelines.
- Familiarity with RESTful APIs and experience integrating with various data sources.
- Strong commitment to data security and privacy regulations.
- Excellent problem-solving skills, attention to detail, and ability to work independently or as part of a team.
- Strong communication and interpersonal skills.