Our Python Developer will have the opportunity to build scalable systems and software for commercial and government use, by developing scalable solutions that leverage modern architecture and best practices, and enable significant processing at runtime. You will provide technical expertise and support in the design, development, implementation, and testing.
You will also participate in and/or direct major deliverables of projects through all aspects of the software development lifecycle including scope and work estimation, architecture and design, coding for back-end, and unit testing. In addition, you would also work with our Data Science team to help operationalize the ML models for our v2 platform.
Your solutions should keep in mind scalability, with optimized usage of distributed computing using frameworks like Spark. You should also have strong familiarity and experience with how to leverage the AWS ecosystem to bring in relevant AWS tools, services, and resources to enable substantial processing of very large datasets before runtime, entity resolution between very large datasets, and real-time processing in a scalable, distributed computing environment.
Primary Responsibilities:
- Lead the development efforts to create platform v2
- Participate in software programming initiatives to support innovation and enhancement, using Python and PySpark.
- Leverage the AWS ecosystem to bring in relevant tools, services, and resources to enable distributed computing and scalable processing of very large datasets.
- Problem solve and think creatively about the big picture and solution for our customers, proactively anticipate problems, and be customer-centric in our development and design, and be open-minded to different solutions for achieving a development milestone.
- Clearly document processes, methodologies, and tools used.
Experience Required:
- B.S. in relevant technical degree
- Significant use and experience (at least 3-5 years) with Python, required
- Significant experience (at least 3-5 years) with distributed computing and corresponding languages such as PySpark in the Spark ecosystem, required
- Significant experience (at least 3-5 years) with the AWS ecosystem, including tools, services, and resources that enable scalable, distributed processing, required
- Significant use and experience with writing complex SQL queries and analysis of data correlations, required
- Experience utilizing software testing performance tools, such as Junit
- Experience and knowledge of Git, AWS CodeCommit, or other such repos
- Knowledge of ML fundamentals and acquaintance of popular ML libraries
- Ability to work independently and integrate with other team members
- Project management skills, ability to scope out timeline, methodology, and deliverables for development, testing, and integration into t