Full Stack LLM Development Associate Manager | Mid-Level | Full time
Job No. R00329504 | Multiple Locations
We Are:
We are at the forefront of a new era in enterprise AI — one that moves beyond isolated models and experiments toward fully governed, production-grade AI systems. Our Data & AI practice brings together more than 45,000 professionals dedicated to helping clients build, deploy, and operate AI at scale. We design and engineer the platforms, runtimes, and developer tooling that make autonomous AI agents a reliable reality for the world's largest organisations.
You Are:
As an Advanced AI Full Stack Engineer, you will design and build the foundational systems that power AI agent platforms — from agent orchestration runtimes and sandboxed execution environments to inference routing layers, SDK tooling, and developer-facing APIs. You are a software engineer first, with deep fluency in Python and Node.js, who thrives at the intersection of distributed systems, AI infrastructure, and developer experience. You will work across the full platform stack — from CLI tooling and event-streaming protocols to multi-tenant Kubernetes-based execution environments — shipping production systems that other engineers and AI agents depend on.
**The Work:
Platform & Runtime Engineering:**
- Design and build agent orchestration runtimes — stateful execution loops that coordinate tool discovery, model inference, approval gates, and context management.
- Implement sandboxed execution environments with declarative policy enforcement (network egress, filesystem, compute quotas) that isolate agent workloads at the infrastructure level.
- Develop pluggable provider interfaces so that sandbox backends (container-based or microVM-based) are swappable without changing agent code.
SDK, API & Developer Tooling:
- Build Python and Node.js/TypeScript SDKs and CLIs that give developers first-class interfaces for authoring, validating, and running AI agents locally and in enterprise environments.
- Design REST, gRPC, and event-streaming APIs (WebSocket, SSE) that serve as the communication backbone between agent runtimes, IDE integrations, and platform services.
- Implement framework adapters that normalize event streams from multiple AI frameworks into a unified platform event model, enabling consistent observability and governance regardless of the underlying agent framework.
Inference Routing & Memory Systems:
- Build and maintain intelligent inference routing layers that intercept model API calls and dispatch them to on-premise or cloud model endpoints based on data-sovereignty, cost, and capability policies.
- Engineer multi-tier memory architectures spanning in-process working memory, cross-session relational stores, vector databases for semantic retrieval, and version-controlled procedural pipelines — each backed by swappable provider interfaces.
- Implement ephemeral credential injection and RBAC-scoped data access so agents operate under least-privilege principles without long-lived secrets in agent code.
Observability, Governance & CI/CD:
- Instrument platform components with distributed tracing (OpenTelemetry), cost attribution, and P50/P95/P99 latency metrics exportable to standard observability backends.
- Build CI/CD governance tooling — static validation pipelines that enforce schema correctness, separation-of-duty rules, and regulatory constraints before agent packages are promoted to production registries.
- Implement human-in-the-loop approval gates and audit-trail mechanisms compatible with enterprise compliance requirements.
Collaboration & Technical Leadership:
- Work closely with cross-functional teams — AI researchers, product managers, security engineers, and enterprise architects — to align platform capabilities with real-world agent use cases.
- Provide technical guidance on platform architecture decisions, code reviews, and engineering best practices across the team.
- Communicate architectural trade-offs and platform roadmap decisions clearly to both technical and non-technical stakeholders.
Travel may be required for this role. The amount of travel will vary from 0 to 100% depending on business need and client requirements.
**This role requires working onsite in Mountain View, CA. Applicants must be local to Mountain View area or willing to relocate prior to joining.
Here's what you need**
- Bachelor's degree (or equivalent minimum 12 years work experience, or minimum 6 years' work experience with Associate's degree) in Computer Science, Computer Engineering, or a related field.
- Minimum of 2 years of experience with Python and/or Node.js/TypeScript building production backend services or platform tooling.
- Minimum of 1 year of experience building or integrating with AI/LLM systems, agent frameworks, or AI developer tooling.
Bonus point is you have
- 4+ years of experience with Python and Node.js/TypeScript, with a strong track record of building and shipping developer-facing platforms, SDKs, or APIs.
- 2+ years of experience in one or more of: agent orchestration frameworks, inference serving infrastructure, sandboxed execution environments, or multi-tenant platform engineering.
- Hands-on experience with async Python frameworks (FastAPI, asyncio), containerisation and Kubernetes, event-streaming protocols (WebSocket, SSE, gRPC), and vector/relational databases.
- Familiarity with AI agent protocols (MCP, ACP, A2A), OpenTelemetry instrumentation, and modern AI framework ecosystems (LangGraph, OpenAI Agents SDK, Anthropic Claude SDK).
- Master's or PhD in Computer Science, Computer Engineering, or a related field is a plus but not required.
Compensation at Accenture varies depending on a wide array of factors, which may include but are not limited to the specific office location, role, skill set, and level of experience. As required by local law, Accenture provides a reasonable range of compensation for roles that may be hired as set forth below.
We anticipate this job posting will be posted until 06/30/2026.
Accenture offers a market competitive suite of benefits including medical, dental, vision, life, and long-term disability coverage, a 401(k) plan, bonus opportunities, paid holidays, and paid time off. See more information on our benefits here:
U.S. Employee Benefits | Accenture
Role Location Annual Salary Range
California $73,800 to $220,400
Cleveland $68,300 to $176,300
Colorado $73,800 to $190,400
District of Columbia $78,500 to $202,700
Illinois $68,300 to $190,400
Maryland $73,800 to $190,400
Massachusetts $73,800 to $202,700
Minnesota $73,800 to $190,400
New York $68,300 to $220,400
New Jersey $78,500 to $220,400
Washington $80,200 to $202,700
#LI-NA-FY25
Mountain View, CA
Albany, NY
Arlington, VA
Atlanta, GA
Austin, TX
Beaverton, OR
Bentonville, AR
Boston, MA
Carmel, IN
Charlotte, NC
Chicago, IL
Cincinnati, OH
Cleveland, OH
Columbus, OH
Culver City, CA
Denver, CO
Des Moines, IA
Detroit, MI
Hartford, CT
Houston, TX
Irving, TX
Kirkland, WA
Miami, FL
Milwaukee, WI
Minneapolis, MN
Morristown, NJ
Nashville, TN
New York City, NY
Oklahoma City, OK
Overland Park, KS
Philadelphia, PA
Pittsburgh, PA
Raleigh, NC
Redmond, WA
Sacramento, CA
San Diego, CA
San Francisco, CA
Scottsdale, AZ
Seattle, WA
St. Louis, MO
St. Petersburg, FL
Walnut Creek, CA
Requesting an Accommodation
Accenture is committed to providing equal employment opportunities for persons with disabilities or religious observances, including reasonable accommodation when needed. If you are hired by Accenture and require accommodation to perform the essential functions of your role, you will be asked to participate in our reasonable accommodation process. Accommodations made to facilitate the recruiting process are not a guarantee of future or continued accommodations once hired.
If you would like to be considered for employment opportunities with Accenture and have accommodation needs such as for a disability or religious observance, please call us toll free at 1 (877) 889-9009 or send us an email or speak with your recruiter.
Equal Employment Opportunity Statement
We believe that no one should be discriminated against because of their differences. All employment decisions shall be made without regard to age, race, creed, color, religion, sex, national origin, ancestry, disability status, veteran status, sexual orientation, gender identity or expression, genetic information, marital status, citizenship status or any other basis as protected by federal, state, or local law. Our rich diversity makes us more innovative, more competitive, and more creative, which helps us better serve our clients and our communities.
Accenture is an EEO and Affirmative Action Employer of Veterans/Individuals with Disabilities.
Accenture is committed to providing veteran employment opportunities to our service men and women.
Other Employment Statements
Applicants for employment in the US must have work authorization that does not now or in the future require sponsorship of a visa for employment authorization in the United States.
Candidates who are currently employed by a client of Accenture or an affiliated Accenture business may not be eligible for consideration.
Job candidates will not be obligated to disclose sealed or expunged records of conviction or arrest as part of the hiring process. Further, at Accenture a criminal conviction history is not an absolute bar to employment.
The Company will not discharge or in any other manner discriminate against employees or applicants because they have inquired about, discussed, or disclosed their own pay or the pay of another employee or applicant. Additionally, employees who have access to the compensation information of other employees or applicants as a part of their essential job functions cannot disclose the pay of other employees or applicants to individuals who do not otherwise have access to compensation information, unless the disclosure is (a) in response to a formal complaint or charge, (b) in furtherance of an investigation, proceeding, hearing, or action, including an investigation conducted by the employer, or (c) consistent with the Company's legal duty to furnish information.
California requires additional notifications for applicants and employees. If you are a California resident, live in or plan to work from Los Angeles County upon being hired for this position, please for additional important information.
Please read Accenture’s Recruiting and Hiring Statement for more information on how we process your data during the Recruiting and Hiring process.
We work with one shared purpose: to deliver on the promise of technology and human ingenuity. Every day, more than 775,000 of us help our stakeholders continuously reinvent. Together, we drive positive change and deliver value to our clients, partners, shareholders, communities, and each other.
We believe that delivering value requires innovation, and innovation thrives in an inclusive and diverse environment. We actively foster a workplace free from bias, where everyone feels a sense of belonging and is respected and empowered to do their best work.
At Accenture, we see well-being holistically, supporting our people’s physical, mental, and financial health. We also provide opportunities to keep skills relevant through certifications, learning, and diverse work experiences. We’re proud to be consistently recognized as one of the World’s Best Workplaces™.
Join Accenture to work at the heart of change. Visit us at www.accenture.com.