We are seeking a Data Architect to lead a Generative AI initiative. The ideal candidate will have a deep understanding of Azure services and capabilities, and experience with architecting and implementing solutions using Azure. They must also possess knowledge of Python, APIs and machine learning frameworks.
Responsibilities
- Design and architect solutions that leverage Azure services and OpenAI technologies to address complex business problems and deliver innovative AI-powered applications.
- Evaluate and recommend appropriate Azure services and OpenAI technologies based on project objectives, scalability, performance, and cost considerations
- Design and implement end-to-end AI solutions, including data acquisition, data preprocessing, prompt engineering, API deployment, and monitoring
- Architect and optimize scalable and reliable cloud-based infrastructure on Azure, ensuring high availability, fault tolerance, and security
- Develop architectural design documents, solution blueprints, and technical specifications to guide the development and implementation process
- Collaborate with stakeholders, including product managers, data scientists, and others, to understand business requirements and translate them into technical solutions
Requirements
- Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
- Minimum of 5 years' experience with large-scale data and analytics solutions
- Knowledge of Azure Data & Analytics PaaS Services: Azure Data Factory, Azure Data Lake, Azure Synapse Analytics, Azure Databricks, Azure IoT, Azure HDInsight + Spark, Azure Cosmos DB, Azure Databricks, Azure Stream Analytics and Azure SQL DB
- Experience with Azure ARM templates, PowerShell and CI/CD using Azure DevOps
- Experience with preparing data for Data Science and Machine Learning purposes
- Experience with Azure data, Machine Learning and Artificial Intelligence solutions
- Ability to conduct data profiling, cataloguing, and mapping for technical design and construction of technical data flows
- Experience with different database technologies including relational and non-relational.
- Experience with exposing data to end-users via Power BI, Azure API Apps.
- Experience in turning business use cases and requirements into technical solutions
Preferred Qualifications :
- Bachelor's or master's degree in computer science, Data Science, Statistics, Math, Physics, or other Science related discipline with course work in data and AI/ML.
- Experience with OpenAI technologies, such as GPT-3, GPT-4 reinforcement learning, or computer
- Knowledge of data privacy and security regulations and best practices related to Azure and AI solutions
- Ability to work collaboratively in a team environment and communicate complex technical concepts to non-techni