Senior QA Analyst / Tester

Home > Python programming jobs

Senior QA Analyst / Tester in USA

Orion Innovation
Full time
Email

USA
09/17/2026
Report

Remote

Responsibilities

Design and execute adversarial testing campaigns against large language models, multimodal systems, and autonomous agents.
Research attack vectors, prompt injection techniques, model vulnerabilities, jailbreaks, and unintended behaviors.
Conduct red team exercises across deployment scenarios and edge cases, testing for bias, toxicity, misinformation, and other harmful outputs.
Create adversarial datasets and benchmarks to evaluate model robustness.
Evaluate AI security tools and collaborate with security and development teams on red teaming activities.
Document and present findings, vulnerabilities, and remediation recommendations.
Maintain process documentation, testing reports, operational metrics, and other programmatic support materials.

Requirements

At least 5 years of penetration testing, red team operations, or AI red team experience.
Background in AI red teaming, red teaming, or offensive cyber operations.
A degree in computer science, information technology, programming, development, artificial intelligence, or cybersecurity, or equivalent work experience; a bachelor's degree or higher is preferred.
Understanding of artificial intelligence, machine learning, software applications, cloud computing, and networking.
Experience with testing tools such as SPLX, Garak, TextAttack, PyRIT, Burp Suite, Metasploit, Nessus, Cobalt Strike, Mythic, NMAP, or sqlmap.
Knowledge of web application technologies and Layer 7 protocols including HTTP, DNS, and FTP.
Technical knowledge of Generative AI, Agentic AI, A2A, and/or MCP.
Programming experience with Python, Ruby, Go, C++, PowerShell, bash, or similar languages.
Strong communication and stakeholder management skills, with the ability to work across geographies and time zones.
OSCP, GPEN, GPXN, AI Red Teamer Job Role Path, AISEC+, GASAE, GOAA, OSAI+, or other AI or red team certifications are desired.

Orion Innovation

Orion Innovation delivers next-generation solutions in Data, AI, Cloud, and Digital Experience, empowering organizations to innovate, scale, and embrace future technologies. With deep software engineering expertise and a strong understanding of industry-specific challenges, we build data-driven p...

Similar positions

Senior, Machine Learning Engineer

Torc Robotics
Full time

USA
09/22/2026
Salary: $177k - $213k/yr

Remote

Senior Software Engineer

Commonwealth Bank of Australia
Full time

Australia
09/22/2026

Sydney

Senior AI Engineer

Jeeves
Full time

Remote
09/22/2026

Brazil

Senior Product Security Engineer

AlphaSense
Full time

USA
09/22/2026
Salary: $182k - $228k/yr

Remote

Senior Staff Software Engineer in

Druva
Full time

Others
09/22/2026

Pune, India