LLM Operations Engineer

Home > Python programming jobs

LLM Operations Engineer in Others new

Accenture
Full time
Email

Others
09/21/2026
Report

Bengaluru, India

Responsibilities

Design and build multi-agent AI systems for planning, reasoning, collaboration, and task execution.
Develop LLM applications, AI copilots, autonomous assistants, and agentic workflows using prompt engineering and orchestration.
Build RAG pipelines, vector-store and knowledge-graph memory mechanisms, and tool-using agents integrated with APIs, databases, and enterprise systems.
Deploy scalable AI solutions using MLOps and LLMOps practices, including monitoring, evaluation, guardrails, caching, and performance optimization.
Design multi-agent collaboration protocols and optimize latency, cost, and accuracy.
Ensure AI safety, governance, security, compliance, and responsible AI practices.

Requirements

At least 5 years of experience is required, with 3–8 years of experience in AI/ML and at least 3 years in Generative AI stated elsewhere in the posting.
15 years of full-time education is required.
Strong Python development skills and experience building API-driven, tool-integrated AI agents.
Experience with multi-agent orchestration, agent planning algorithms, LLM evaluation frameworks, graph-based reasoning, knowledge graphs, and enterprise copilots or autonomous systems.
Hands-on experience with OpenAI, Hugging Face Transformers, LangChain, AutoGen, CrewAI, Semantic Kernel, FAISS, Pinecone, and Weaviate.
Experience with cloud platforms, preferably Azure OpenAI, with AWS and GCP accepted; knowledge of Docker and Kubernetes.
Understanding of prompt engineering, chain-of-thought reasoning, tool augmentation, context management, and token optimization.
Experience balancing latency, cost, and accuracy and translating business workflows into agent pipelines.
Domain experience in industrial, energy, or IoT environments is noted.

Benefits

The position is based at the company's Pune office.

Accenture

Accenture helps the world’s leading enterprises reinvent by building their digital core and unleashing the power of AI to create value at speed for organizations across industries. Our strategy is to be the reinvention partner of choice for our clients and lead in the safe, widespread adoption of...

Similar positions

Senior, Machine Learning Engineer

Torc Robotics
Full time

USA
09/22/2026
Salary: $177k - $213k/yr

Remote

Senior Software Engineer

Commonwealth Bank of Australia
Full time

Australia
09/22/2026

Sydney

Deployed Engineer, Professional Services

LangChain
Full time

Remote
09/22/2026
Salary: Competitive

APAC

Senior AI Engineer

Jeeves
Full time

Remote
09/22/2026

Brazil

Senior Product Security Engineer

AlphaSense
Full time

USA
09/22/2026
Salary: $182k - $228k/yr

Remote