Principal QA Engineer (AI, Azure)

Job Description

We are looking for a QA/QC Engineer with solid testing and interpersonal skills. As an AI QA Engineer specializing in Azure, you'll focus on ensuring the quality and reliability of AI solutions built on the Azure platform.

Responsibilities

● Testing AI Models and Applications: You'll perform various testing methodologies (manual, automated, performance, etc.) to identify bugs, performance issues, and other defects in AI models, applications, and workflows developed on Azure.

● Model Evaluation and Optimization: You'll evaluate the performance of AI models, identify areas for improvement, and collaborate with AI engineers to optimize models for accuracy, speed, and efficiency.

● Data Quality Assurance: You'll ensure the quality and integrity of the data used to train and deploy AI models, including data cleaning, transformation, and validation.

● Collaboration and Communication: You'll work closely with AI engineers, data scientists, software developers, and product managers to understand requirements, identify issues, and ensure the successful deployment of AI solutions

● Automated Testing: You'll develop and maintain automated test suites to ensure consistent and reliable testing of AI models and applications.

● Troubleshooting and Debugging: You'll investigate and resolve issues related to AI model performance, data pipelines, and application functionality.

● Staying Up-to-Date: You'll keep abreast of the latest advancements in AI technologies and best practices for AI testing and quality assurance.

● Azure AI Services Expertise: You'll have a strong understanding of Azure AI services, including Azure Machine Learning, Azure Cognitive Services, and Azure Databricks.

● Data Pipeline Expertise: You'll have experience with data pipelines and workflows, including data ingestion, transformation, and storage.

● AI Workflow Implementation: You'll be involved in the implementation of AI workflows and integration of AI services with solution components.

● Monitoring and Evaluation: You'll monitor the performance of AI solutions in production and evaluate their effectiveness.

Your Skills and Experience

● 8+ years of experience in testing

● Experience in testing AI solutions built on the Azure platform

● Preferably a bachelor’s degree in IT, Computer Science or related fields

● Solid skills and knowledge of testing processes and techniques

● Experience in test automation with any frameworks, any programming languages

● Experience in working in cross functional or agile teams

● Experience in API testing with Postman or other tools

● Familiar with issue and test management tools like Jira, TestRail…

● Good English communication and documentation skills

● Great interest in testing, open minded and able to self-motivated

● ISTQB or equivalent testing certificate is a plus