Inference Performance Engineer - MaaS

Home > Python programming jobs

Inference Performance Engineer - MaaS in Others new

BitDeer Technologies Group
Full time
Email

Others
10/16/2026
Report

Singapore, Singapore

Responsibilities

Profile production request streams across chat, completion, embedding, and fine-tuning endpoints and maintain statistical traffic models by model and customer segment.
Validate load-testing and benchmarking harnesses against production telemetry, updating workload generators, request mixes, and concurrency patterns as traffic changes.
Build capacity forecasts and cost-per-token or cost-per-request models that inform GPU fleet sizing, capacity mix, and MaaS pricing strategy.
Define and maintain canonical metrics for latency percentiles, time-to-first-token, inter-token latency, end-to-end latency, throughput, and utilization.
Document instrumentation and aggregation standards, audit dashboards for metric drift, and resolve metric-definition differences across teams.
Build performance and cost dashboards, reports, and postmortem inputs, and review performance or cost claims before business decisions.

Requirements

5+ years of experience in performance engineering, capacity planning, or applied ML systems work on large-scale, GPU-backed, or latency-sensitive distributed services, including experience with LLM or ML inference workloads.
Hands-on experience statistically characterizing production traffic, including request rates, token lengths, concurrency, and burstiness, using Python/pandas, SQL, Spark, or a comparable data-analysis stack.
Working knowledge of LLM inference internals such as continuous batching, KV-cache management, and prefill/decode scheduling, plus familiarity with modern inference-serving frameworks.
Experience designing, running, or auditing load-testing and benchmarking tooling and reconciling results with live production telemetry.
Experience modeling GPU utilization and cost per token or request with infrastructure and finance/FinOps teams, including on-demand, reserved, and spot capacity trade-offs.
Fluency with observability and distributed-tracing tools and experience defining durable, cross-team performance metrics.
Ability to communicate analytical findings and explain performance and cost metrics to engineering, product, leadership, and finance stakeholders.

Benefits

Inclusive, diverse, and collaborative work environment with open workspaces and a startup atmosphere.
Opportunity to contribute directly to new projects and the future of the digital asset industry.
Networking opportunities with industry pioneers and enthusiasts.
Personal accountability, autonomy, rapid growth, training, mentoring, and other developmental opportunities.
Attractive welfare benefits.

BitDeer Technologies Group

Bitdeer Technologies Group (NASDAQ: BTDR) builds and operates Bitcoin‑mining infrastructure and AI/HPC cloud services for miners and enterprise compute customers. The Singapore‑headquartered public company, founded in 2021, designs ASIC chips and manufactures mining rigs, and runs data centers ac...

Similar positions

Senior Okta Engineer (IAM)

Charger Logistics Inc.
Full time

Remote
10/16/2026
Salary: Competitive

Canada

Staff Enterprise Security Engineer

Twilio
Full time

UK
10/16/2026
Salary: Competitive

Remote

Senior ML Ops Engineer

Confido
Full time

USA
10/16/2026
Salary: $210k - $300k/yr

New York, NY

Sr Engineer, Data & Analytics Platform

FICO
Full time

USA
10/16/2026
Salary: $105k-$165k

Remote

Senior Threat Intelligence Engineer

Coalition
Full time

Canada
10/16/2026
Salary: $107k - $190k/yr

Remote