Your browser does not support javascript! Please enable it, otherwise web will not work for you.

Software Architect, AI Applications

Home > Java programming jobs

Software Architect, AI Applications in Others

  • Gong.io
  • Full time
  • Email
  • Tel Aviv-Yafo, Israel

Responsibilities

  • Define the reference architecture and cross-system contracts for the Revenue Harness agentic framework.
  • Design and build agent orchestration, planning and reasoning loops, multi-step execution, multi-agent coordination, tools, integrations, context, memory, and model routing.
  • Contribute directly to system design and code while embedding with teams across domains.
  • Establish evaluation methodology, regression gates, production monitoring, guardrails, permissions, and reliability standards for non-deterministic systems.
  • Design high-concurrency stateful and stateless agent runtimes with lifecycle management, isolated workers, task queues, distributed state persistence, and cloud-native deployment.
  • Mentor engineers, raise design and engineering standards, and lead through influence across multiple teams.
  • Drive adoption of coding agents, AI code review, and agentic development workflows.

Requirements

  • 10+ years of backend development experience with strong Java expertise and modern frameworks such as Spring Boot.
  • Proven Staff- or Principal-level impact across multiple teams and the ability to lead through influence rather than authority.
  • Hands-on experience shipping production LLM applications such as agents, tool calling, RAG, or structured generation, including understanding of their failure modes.
  • Deep expertise designing large-scale distributed systems, including asynchronous, event-driven, and streaming architectures.
  • Ability to work across unfamiliar codebases, switch context across teams, identify high-impact opportunities, and communicate complex ideas clearly.
  • Experience mentoring engineers and driving adoption of AI-assisted development.
  • Preferred experience with MCP, Spring AI, LangChain, LangGraph, or equivalent agent frameworks and protocols.
  • Preferred experience with LLM evaluation, observability, multi-provider routing, vector databases, Elasticsearch, OpenSearch, or knowledge graphs.
  • Familiarity with prompt injection, data leakage, agent permission models, and other AI security concerns.
  • Working knowledge of Python alongside a JVM stack and experience in B2B SaaS, CRM, or revenue technology are preferred.

Benefits

  • Flexible hybrid work model combining work from home, on the go, and in-office work.
  • Ownership, autonomy, mentorship, and opportunities to influence products and engineering standards.

Gong.io

Transform how your revenue team wins with AI✨ The Gong Revenue AI Operating System brings customer data, insights, and workflows together in one trusted place. 5,000+ companies rely on Gong to understand their business better, automate workflows, and win more. Follow our page for more updates.

Similar positions

Full Stack Software Engineer 4

  • Netflix
  • Full time
  • USA
  • 10/15/2026
  • Salary: $250k-$413k
  • Remote

Software Engineer

  • Barclays
  • Full time
  • Others
  • 10/15/2026
  • Pune, India

Senior Software Engineer C++ - Backend

  • Jitterbit
  • Full time
  • Remote
  • 10/15/2026
  • India

Software Engineer - Research Data Platform

  • IMC
  • Full time
  • Others
  • 10/15/2026
  • Mumbai, India

Software Engineer (Merchant Product)

  • ByteDance
  • Full time
  • Others
  • 10/15/2026
  • Singapore, Singapore