Energy Impact Partners
95
companies
1,083
Jobs

Sr. QA Engineer

MessageBroadcast

MessageBroadcast

Quality Assurance
Ocean City, MD, USA
Posted on Nov 26, 2024

***THIS ROLE IS NOT ELIGIBLE FOR THE BENEFITS LISTED BELOW THE JOB DESCRIPTION***

Message Broadcast is seeking a skilled Senior Quality Assurance (QA) Engineer with expertise in testing AI-powered systems and a strong foundation in cloud technologies to join our team. In this role, you will design, execute, and improve QA processes to ensure the reliability, scalability, and performance of AI chat assistants built using platforms like GPT (OpenAI) and Amazon Bedrock. You will collaborate with developers, product managers, and stakeholders to deliver high-quality conversational AI solutions that exceed customer expectations.

What You’ll Do

  • Develop QA Strategies: Create and implement comprehensive testing strategies for AI chat assistant systems, covering functional, integration, performance, and regression testing.

  • Collaborate with Teams: Work closely with developers, product managers, and stakeholders to understand requirements and provide actionable feedback.

  • Test AI Models: Validate the functionality, accuracy, and performance of conversational AI systems, ensuring that they meet user needs and organizational standards.

  • Automate Testing: Design, build, and maintain automated test scripts for end-to-end testing of chat assistant platforms and APIs.

  • Performance Testing: Conduct load and stress testing to identify and address system bottlenecks in high-throughput environments.

  • Report and Track Bugs: Identify, document, and manage defects using tracking tools, ensuring timely resolution by the development team.

  • Enhance Testing Tools: Leverage and improve existing testing frameworks to support AI model validation and seamless integration.

  • Monitor in Production: Participate in post-deployment testing and ongoing system monitoring to ensure reliability and identify areas for improvement.

  • Mentor and Lead: Guide junior QA engineers, fostering a culture of quality and continuous improvement.

  • Stay Updated: Keep up with the latest trends in AI, testing frameworks, and tools to bring innovative practices to the team.

Qualifications

What You Have – Required Skills:

  • 5+ years of experience in quality assurance, with at least 2 years focused on testing AI, machine learning, or natural language processing systems.

  • Strong understanding of QA methodologies, tools, and best practices in agile development environments.

  • Experience testing APIs and backend systems, particularly those developed in Java/J2EE.

  • Hands-on experience with cloud platforms (Google Cloud, AWS, or Azure).

  • Proficiency in test automation tools (e.g., Selenium, JMeter, Postman, or similar).

  • Familiarity with AI platforms like GPT (OpenAI) or Amazon Bedrock.

  • Experience with performance testing of high-throughput, distributed systems.

  • Knowledge of database technologies (e.g., MySQL, NoSQL) for validating data consistency.

  • Strong analytical skills and the ability to troubleshoot complex systems.

  • Excellent communication skills, with the ability to convey technical issues to non-technical stakeholders.

Preferred Skills:

  • Knowledge of natural language processing (NLP) and conversational AI systems.

  • Experience with CI/CD pipelines and tools like Jenkins, GitLab CI, or CircleCI.

  • Familiarity with containerization tools like Docker and orchestration systems like Kubernetes.

  • Understanding of ethical considerations in testing AI systems, such as bias and fairness.

  • Prior experience in mentoring or leading QA teams.

BENEFITS

  • Fully covered Medical, Dental, and Vision coverage for employees

    • Cost share for dependents

  • 401(K) plan with company match

  • Flexible PTO policy

  • 9 paid holidays

Message Broadcast is an Equal Opportunity Employer and all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability status, protected veteran status, or any other characteristic protected by law.