Your browser does not support javascript! Please enable it, otherwise web will not work for you.

Cyber Evaluations Engineer

Home > Python programming jobs

Cyber Evaluations Engineer in USA

  • Anthropic
  • Full time
  • Email
  • Washington, DC

Responsibilities

  • Design and run capability, uplift, and safety evaluations for cyber-relevant model risks.
  • Execute safeguard-robustness testing before major model releases.
  • Analyze evaluation results and communicate findings to teams and stakeholders.
  • Design, prototype, and tune detection probes for cyber misuse.
  • Partner with cyber policy and engineering teams to translate policy lines into layered abuse-detection architecture and measure precision and coverage.
  • Build and maintain internal tooling for running and scoring evaluations.
  • Collaborate on converting evaluation findings into safeguard improvements.

Requirements

  • Experience building or running evaluations, benchmarks, or test suites for software or ML systems on short, fixed timelines.
  • Hands-on cybersecurity experience such as CTF participation, vulnerability research, exploit development, or security research.
  • Proficiency in Python.
  • Strong ability to communicate evaluation results with cross-functional and policy stakeholders.
  • Bachelor’s degree in a relevant field or an equivalent combination of education, training, and experience.
  • Preferred qualifications include deep offensive-security or security-research experience, AI security benchmark development, adversarial or abuse-data analysis, AI/ML evaluation frameworks, coordinated vulnerability disclosure, pre-release testing, detection-content authoring, ML-based abuse detection, and an active secret clearance or eligibility to obtain one.

Benefits

  • Hybrid work with staff expected to be in an Anthropic office at least 25% of the time, with some roles requiring more office time.
  • Visa sponsorship may be available, with immigration-lawyer support.
  • Competitive benefits, flexible working hours, generous vacation and parental leave, optional equity donation matching, and office collaboration space.

Salary: $300k - $405k/yr

Anthropic

Anthropic builds AI systems that are reliable, interpretable, and steerable, with a commitment to ensuring their safety and benefit to users and society. Our work is driven by a dedicated team of researchers, engineers, and policy experts focused on the development of beneficial AI solutions.

Similar positions

Senior Software Engineer

  • Two Six Technologies
  • Full time
  • USA
  • 10/30/2026
  • Salary: $125k - $188k/yr
  • Remote

Senior Software Engineer

  • Coinbase
  • Full time
  • USA
  • 10/30/2026
  • Salary: $186k - $219k/yr
  • Remote

Senior Threat Detection Engineer

  • Blackbaud
  • Full time
  • USA
  • 10/30/2026
  • Salary: $102k-$133k
  • Remote

Software Developer, Data Engineering

  • Robinhood
  • Full time
  • Canada
  • 10/30/2026
  • Toronto

Platform Engineer, Biotech

  • Clera
  • Full time
  • USA
  • 10/30/2026
  • Salary: $180k - $240k/yr
  • San Francisco, CA