At EY, you’ll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. And we’re counting on your unique voice and perspective to help EY become even better, too. Join us and build an exceptional experience for yourself, and a better working world for all. 

Job Title: AI Test Engineer
Job Summary: We are looking for a motivated individual to join our AI Testing team. As a staff AI Test Engineer, you will assist in developing and executing test cases for AI models and systems, ensuring they meet quality and performance standards. You will collaborate with experienced engineers and data scientists to gain hands-on experience in AI testing.
Key Responsibilities:
Test case design:

Good understanding about the various testing touch points in a model development lifecycle
Participate in discussions with team members to understand testing needs.
Support the development of test cases based on project requirements.
Ability to define test cases to validate input data, Model functional performance, Model response etc

Test Execution:

Execute manual tests for AI models and document results.
Prior experience in performing AI specific testing methods like Pairwise testing, Metamorphic testing, Back-to-Back testing, Bias Testing, Drift testing etc
Knowledge on responsible AI testing
Knowledge on explainability testing tools (e.g., LIME, SHAP etc.)
Assist in running automated tests and analysing their outcomes.

Model Validation Support:

Help validate AI models against performance metrics such as accuracy and recall.
Learn to conduct exploratory testing to identify potential issues.
Exposure to testing LLM models

Data Quality Checks:

Collaborate with data teams to ensure the quality of datasets used in testing.
Participate in data validation activities to maintain data integrity.
Prior experience in performing various data validation activities like data collection/generation, data augmentation, Exploratory data analysis, data bias and privacy etc

Documentation:

Document test results and maintain clear records of defects found during testing.
Prepare summary reports of testing activities for review.

Learning and Development:

Stay informed about AI testing best practices and tools.
Seek guidance from senior engineers to improve testing skills and knowledge.

 
Education: Bachelor’s degree in Computer Science, Engineering, or a related field; Master’s degree preferred.
Experience:

1-4 years of experience in software testing / development with exposure to Python
1+ years in testing on AI/ML applications.

Technical Skills:

Basic understanding of AI/ML concepts and algorithms.
Familiarity with programming languages such as Python or Java is a plus.
Exposure to software testing principles and practices.
Strong analytical and problem-solving skills.
Attention to detail and a commitment to quality.
Experience with testing tools (e.g., Selenium, PyTest) through coursework or internships.
Knowledge of version control systems (e.g., Git) is a plus.
Experience with Agile methodologies is a bonus.

EY | Building a better working world 

 
EY exists to build a better working world, helping to create long-term value for clients, people and society and build trust in the capital markets.  

 
Enabled by data and technology, diverse EY teams in over 150 countries provide trust through assurance and help clients grow, transform and operate.  

 
Working across assurance, consulting, law, strategy, tax and transactions, EY teams ask better questions to find new answers for the complex issues facing our world today.