Your browser does not support javascript! Please enable it, otherwise web will not work for you.

Senior QA Analyst / Tester

Home > Python programming jobs

Senior QA Analyst / Tester in USA

  • Orion Innovation
  • Full time
  • Email
  • Remote

Responsibilities

  • Design and execute adversarial testing campaigns against large language models, multimodal systems, and autonomous agents.
  • Research attack vectors, prompt injection techniques, model vulnerabilities, jailbreaks, and unintended behaviors.
  • Conduct red team exercises covering deployment scenarios and edge cases, including testing for bias, toxicity, misinformation, and other harmful outputs.
  • Evaluate and introduce AI security tools to reduce detection and response time for AI-specific threats.
  • Create adversarial datasets and benchmarks to evaluate model robustness under attack conditions.
  • Collaborate with security teams and developers to conduct red teaming activities and improve the organization’s security posture.
  • Document and present vulnerabilities, findings, risks, and remediation recommendations.
  • Maintain process documentation, produce testing reports, track operational metrics, and support other AI Red Team program activities.

Requirements

  • Minimum five years of penetration testing, red team operations, or AI Red Team experience.
  • Bachelor's or higher degree in computer science, information technology, programming, development, artificial intelligence, or cybersecurity, or equivalent work experience.
  • Background in AI red teaming, red teaming, or offensive cyber operations.
  • Understanding of artificial intelligence, machine learning, software applications, cloud computing, and networking.
  • Experience with relevant testing and security tools such as SPLX, Garak, TextAttack, PyRIT, Burp Suite, Metasploit, Nessus, Cobalt Strike, Mythic, Nmap, and sqlmap, or similar tools.
  • Knowledge of web application technologies and Layer 7 protocols including HTTP, DNS, and FTP.
  • Technical knowledge of Generative AI, Agentic AI, A2A, and/or MCP.
  • Programming experience with Python, Ruby, Go, C++, PowerShell, bash, or similar languages.
  • Relevant AI red team or security certifications such as OSCP, GPEN, GPXN, AI Teamer Job Role Path, AISEC+, GASAE, GOAA, or OSAI+ is desired.
  • Strong communication and stakeholder management skills, with the ability to work across geographies and time zones.

Orion Innovation

Orion Innovation delivers next-generation solutions in Data, AI, Cloud, and Digital Experience, empowering organizations to innovate, scale, and embrace future technologies. With deep software engineering expertise and a strong understanding of industry-specific challenges, we build data-driven p...

Similar positions

Senior Devops Engineer

  • Woliba
  • Full time
  • USA
  • 09/13/2026
  • Remote

Senior Core Infrastructure Engineer

  • Oracle
  • Full time
  • USA
  • 09/13/2026
  • Salary: Competitive
  • Nashville, TN

Senior Software Engineer, ML Ops

  • PathAI
  • Full time
  • USA
  • 09/13/2026
  • Salary: $128k - $196k/yr
  • Boston, MA

Senior Backend Software Engineer

  • LangChain
  • Full time
  • USA
  • 09/13/2026
  • Salary: $180k - $240k/yr
  • Boston, MA

Senior/Staff Full Stack Engineer

  • Workstream
  • Full time
  • Canada
  • 09/13/2026
  • Salary: Competitive
  • Vancouver

Listings

by


Job Type

Language

Country

CodingJobBoard.com © 2026