Job Overview We are seeking a skilled Data Engineer to join our dynamic team. In this role, you will be responsible for designing, developing, and maintaining robust data pipelines and architectures that support our data-driven decision-making processes. You will work closely with data analysts and other stakeholders to ensure the availability and quality of data for analytics and reporting purposes.
Duties
- Design and implement scalable data pipelines using ETL processes to extract, transform, and load data from various sources into data warehouses.
- Collaborate with cross-functional teams to gather requirements and translate them into technical specifications.
- Develop and maintain databases using Microsoft SQL Server, Oracle, and Azure Data Lake.
- Utilize big data technologies such as Hadoop, Apache Hive, Spark, and Talend to manage large datasets effectively.
- Implement data models and perform model training to enhance predictive analytics capabilities.
- Ensure data integrity by performing regular audits and implementing best practices in database design.
- Create RESTful APIs for seamless integration of data services across applications.
- Conduct performance tuning of SQL queries and optimize database performance.
- Participate in Agile development processes to deliver high-quality solutions in a timely manner.
Skills
- Proficiency in AWS services for cloud-based data solutions.
- Strong programming skills in Java and Python for data manipulation and analysis.
- Experience with analytics tools such as Looker for visualizing complex datasets.
- Familiarity with linked data concepts and their application in database design.
- Knowledge of Shell Scripting (Bash) for automation of tasks within Unix environments.
- Excellent analysis skills to interpret complex datasets and derive actionable insights.
- Understanding of Agile methodologies to enhance team collaboration and project delivery. We are looking for candidates who are passionate about working with data, possess strong problem-solving abilities, and are eager to contribute to innovative projects that drive business success. If you meet these qualifications and are ready to take on a challenging role as a Data Engineer, we encourage you to apply.
Pay: $60,000.00 - $75,000.00 per year
Benefits:
Work Location: In person