Senior QA Analyst / Tester

Home > Python programming jobs

Senior QA Analyst / Tester in USA

Orion Innovation
Full time
Email

USA
09/17/2026
Report

Remote

Responsibilities

Design and execute adversarial testing campaigns against large language models, multimodal systems, and autonomous agents.
Research attack vectors, prompt injection techniques, model vulnerabilities, jailbreaks, and unintended behaviors.
Conduct red team exercises across deployment scenarios and edge cases, testing for bias, toxicity, misinformation, and other harmful outputs.
Create adversarial datasets and benchmarks to evaluate model robustness.
Evaluate AI security tools and collaborate with security and development teams on red teaming activities.
Document and present findings, vulnerabilities, and remediation recommendations.
Maintain process documentation, testing reports, operational metrics, and other programmatic support materials.

Requirements

At least 5 years of penetration testing, red team operations, or AI red team experience.
Background in AI red teaming, red teaming, or offensive cyber operations.
A degree in computer science, information technology, programming, development, artificial intelligence, or cybersecurity, or equivalent work experience; a bachelor's degree or higher is preferred.
Understanding of artificial intelligence, machine learning, software applications, cloud computing, and networking.
Experience with testing tools such as SPLX, Garak, TextAttack, PyRIT, Burp Suite, Metasploit, Nessus, Cobalt Strike, Mythic, NMAP, or sqlmap.
Knowledge of web application technologies and Layer 7 protocols including HTTP, DNS, and FTP.
Technical knowledge of Generative AI, Agentic AI, A2A, and/or MCP.
Programming experience with Python, Ruby, Go, C++, PowerShell, bash, or similar languages.
Strong communication and stakeholder management skills, with the ability to work across geographies and time zones.
OSCP, GPEN, GPXN, AI Red Teamer Job Role Path, AISEC+, GASAE, GOAA, OSAI+, or other AI or red team certifications are desired.

Orion Innovation

Orion Innovation delivers next-generation solutions in Data, AI, Cloud, and Digital Experience, empowering organizations to innovate, scale, and embrace future technologies. With deep software engineering expertise and a strong understanding of industry-specific challenges, we build data-driven p...

Similar positions

Senior Attack Engineer, Kubernetes

Horizon3 AI
Full time

USA
11/07/2026
Salary: $206k - $243k/yr

Remote

Staff AI Security Analyst

Agoda
Full time

Others
11/07/2026

Singapore, Singapore

Senior Analytics Engineer

Mercury
Full time

Remote
11/07/2026
Salary: $167k-$208k

Canada, USA

Senior Machine Learning Engineer

Wiser Solutions
Full time

Canada
11/06/2026
Salary: C$160k-C$200k

Remote

ML/AI - Supply Chain

Samsara
Full time

USA
11/06/2026
Salary: $179k - $319k/yr

Remote