Staff Engineer / AI Builder

Home > Python programming jobs

Staff Engineer / AI Builder in Canada

Robots and Pencils
Full time
Email

Canada
10/08/2026
Report

Remote

Responsibilities

Design and build agentic workflows using reasoning loops, tool and function calling, and single- or multi-agent orchestration.
Build and maintain RAG pipelines covering chunking, embeddings, vector search, re-ranking, and knowledge refresh handling.
Integrate AWS Bedrock and Agent Core, including MCP-based tool design and agent memory or session management.
Create production system prompts, evaluation datasets, LLM-as-judge workflows, RAGAS-style metrics, and tracing or observability.
Design reliability patterns for LLM systems, including retries, backoff, jitter, circuit breakers, fallback models, and degradation handling.
Build Python and Node.js backend services, AWS serverless architectures, DynamoDB schemas, and event-driven workflows.
Contribute to frontend integration, deployment, monitoring, troubleshooting, debugging, and production hardening.
Provide technical leadership, establish engineering standards, mentor engineers, and own features and releases end-to-end.

Requirements

6+ years of professional software engineering experience, including meaningful experience shipping GenAI or LLM-powered systems in production.
Hands-on expertise with agentic AI, reasoning loops, tool or function calling, and single- and multi-agent orchestration.
Practical RAG expertise with chunking strategies, embeddings, vector databases, cosine similarity search, and re-ranking.
Experience building LLM evaluation and observability systems using golden datasets, LLM-as-judge, RAGAS or comparable metrics, and tracing tools.
Strong production prompt-engineering skills involving structured role framing, output constraints, and few-shot design.
Hands-on experience with AWS Bedrock, Agent Core, Lambda, DynamoDB single-table design, S3, SQS, EventBridge, and Step Functions.
Strong Python and Node.js skills with experience building full-stack applications and APIs.
Understanding of production reliability patterns for LLM-backed systems, including retries, backoff, circuit breakers, and fallback models.
Experience with Docker and cloud-native deployment, plus the ability to own ambiguous and integration-heavy technical problems.
Helpful qualifications include direct Amazon Bedrock Agent Core experience, regulated-domain experience, familiarity with Sequencer or similar state-machine orchestration, and production experience with LLM observability tooling.

Benefits

Annual base salary range of CAD $176,612–$243,680.

Robots and Pencils

Robots & Pencils is an applied AI engineering firm that designs, builds, and runs production AI systems and agentic co-workers for enterprise operations, with a focus on AWS. The privately held company, founded in 2009 and headquartered in Chagrin Falls, Ohio, provides consulting and implementati...

Similar positions

Staff Machine Learning Engineer

Altana
Full time

USA
10/15/2026
Salary: $205k - $240k/yr

Boston, MA

Security Platform Automation Engineer

Apple
Full time

USA
10/15/2026

Seattle, WA

Analytics Engineer

Reddit
Full time

USA
10/15/2026
Salary: $164k-$230k

Remote

Senior AI Engineer

Infiterra S.A
Full time

Remote
10/15/2026

Greece, UK

Security Operations Engineer (SecOps)

Collibra
Full time

USA
10/15/2026
Salary: $116k - $145k/yr

Remote