Software Development Engineer in Test- AI Full-time

EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential.

We are seeking a highly experienced Software Development Engineer in Test for AI Testing to join our team.

In this role, you will develop and test AI-based applications using open-source tools and frameworks. You will utilize your strong Python development skills and expertise in machine learning libraries such as scikit-learn, Pandas, and Numpy, to build and test retrieval augmentation generation (RAG) based applications.

Responsibilities

• Design and develop test plans and test cases for AI-based applications
• Collaborate with cross-functional teams to ensure the quality and accuracy of the AI-based applications
• Develop and maintain test automation frameworks for AI-based applications
• Conduct performance and scalability testing of AI-based applications
• Provide technical guidance and mentorship to junior team members
• Stay up-to-date with emerging trends and technologies in AI testing

Requirements

• Minimum of 5 years of experience in Software, System, and Test Engineering with mandatory working project experience in testing AI-based applications
• Expertise in Python development and machine learning libraries such as scikit-learn, Pandas, and Numpy
• Experience in building and testing retrieval augmentation generation (RAG) based applications using open-source tools and frameworks
• Strong knowledge of Langchain components and Langsmith, vector databases, and prompt engineering skills
• Ability to evaluate and test LLMs using tools and open-source libraries
• Excellent verbal and written communication skills in English at a B2 level

Nice to have

• AI Developer certification from any of the cloud providers (AWS, Azure, GCP)
• Exposure to tools and open-source libraries for the evaluation and testing of LLMs

We offer

• Opportunity to work on technical challenges that may impact across geographies
• Vast opportunities for self-development: online university, knowledge sharing opportunities globally, learning opportunities through external certifications
• Opportunity to share your ideas on international platforms
• Sponsored Tech Talks & Hackathons
• Unlimited access to LinkedIn learning solutions
• Possibility to relocate to any EPAM office for short and long-term projects
• Focused individual development
• Benefit package:
  • Health benefits
  • Retirement benefits
  • Paid time off
  • Flexible benefits
• Forums to explore beyond work passion (CSR, photography, painting, sports, etc.)