Line of Service
Advisory
Industry/Sector
Not Applicable
Specialism
Emerging Technologies
Management Level
Senior Associate
Job Description & Summary
A career in our Technology Consulting practice, within General Consulting services, will provide you with the opportunity to help clients seize essential advantages by working alongside business leaders to solve their toughest problems and capture their greatest opportunities. We work with some of the world’s largest and most complex companies to understand their unique business issues and opportunities in an ever changing environment. We help create sustainable change by stimulating innovation, unlocking data possibilities, navigating risk and regulatory complexity, optimising deals, and aligning costs with business strategy to create a competitive advantage.
As a member of the team, you’ll work with clients to define their vision and plan how to get there. We deliver the technological solutions organisations need to compete and grow and build a lasting legacy of improvement and performance, partnering with best in class technologies and solution sets. In joining, you’ll help our clients understand and evolve the way they align Information Technology with their business strategy, create integrated end to end solutions, and use enterprise applications to solve complex business problems.
*Why PWC
At PwC, you will be part of a vibrant community of solvers that leads with trust and creates distinctive outcomes for our clients and communities. This purpose-led and values-driven work, powered by technology in an environment that drives innovation, will enable you to make a tangible impact in the real world. We reward your contributions, support your wellbeing, and offer inclusive benefits, flexibility programmes and mentorship that will help you thrive in work and life. Together, we grow, learn, care, collaborate, and create a future of infinite experiences for each other. Learn more about us.
At PwC, we believe in providing equal employment opportunities, without any discrimination on the grounds of gender, ethnic background, age, disability, marital status, sexual orientation, pregnancy, gender identity or expression, religion or other beliefs, perceived differences and status protected by law. We strive to create an environment where each one of our people can bring their true selves and contribute to their personal growth and the firm’s growth. To enable this, we have zero tolerance for any discrimination and harassment based on the above considerations. “
Responsibilities: • Design, develop, and maintain automated test
frameworks and scripts for chat interface applications
• utilizing LLMs, ensuring comprehensive coverage of
all functionalities and user scenarios.
• Understand Retrieval Augmented Generation(RAG)
strategy to improve testing for knowledge-
• intensive tasks by retrieving relevant documents or
data that can be used as references or benchmarks
• for evaluating the LLM’s responses
• Evaluate chat interactions for adherence to
conversational design principles, ensuring responses
are
• accurate, relevant, and delivered within acceptable
time frames.
• Perform thorough regression testing when bugs are
resolved and when there are updates to LLMs or
• application features.
• Collaborate with development teams to understand
application features and integration points for
• Large Language Models, identifying potential areas
for automation.
• Execute automated and manual test cases, analyze
test results, identify and document defects, and
• work closely with developers to ensure they are
addressed promptly.
• Monitor the performance of LLMs in the chat
interface, identifying any issues with latency,
accuracy,
• or relevance of responses.
• Stay up-to-date with the latest developments in AI,
machine learning, and chatbot technologies to
• continually improve testing strategies and tools.
• Collaborate with product managers and UX designers
to ensure the chat application meets the highest
• standards of user satisfaction and engagement.
• Ensure compliance with data privacy and security
policies during the testing process, especially when
• handling sensitive user data.
• Provide detailed reports and documentation on test
activities, results, insights, and recommendations
• for improving the application& quality and
performance.
• Tools Exposure Expected:.
Mandatory skill sets: Python, Machine Learning, Prompt Engineering, Java-
Selenium, Python Robot Framework
Preferred skill sets: LLM, Data Processing, SQL, Azure, CI/CD, Jira
Years of experience required: 4 to 7 years
Education qualification: B.E/B.Tech
Education (if blank, degree and/or field of study not specified)
Degrees/Field of Study required: Bachelor of Engineering
Degrees/Field of Study preferred:
Certifications (if blank, certifications not specified)
Required Skills
Python (Programming Language)
Optional Skills
Desired Languages (If blank, desired languages not specified)
Travel Requirements
Available for Work Visa Sponsorship?
Government Clearance Required?
Job Posting End Date
If you’re a professional who works with text, we have an exciting opportunity to use your writing, editing, technical, and...
How to applyAbout FullStack FullStack is the fastest-growing software consultancy in the Americas. We help organizations like Uber, GoDaddy, MGM, Siemens, and...
How to applyYour Role and Responsibilities As a Brand Technical Specialist you’ll work closely with clients to develop relationships, understand their needs,...
How to applyBluelight Consulting is a leading software consultancy dedicated to designing and developing innovative technology that enhances users’ lives. With a...
How to applyAbout the Team Come help us build the world’s most reliable on-demand, logistics engine for last-mile retail delivery! We’re looking...
How to applyWith a startup spirit and 115,000 + curious and courageous minds, we have the expertise to go deep with the...
How to apply