Explore AI roles

Keyboard friendly • Copy, share & save roles

Sort by

Robots & Pencils is seeking an outcome-oriented AI Engineer to partner with a strategic client on a high-impact AI sy...

Fulltime Remote Ai Ai Engineer

Fully remote

Apply

This posting is for a contract assignment and is not a full-time employment offer with Boeing. Candidates selected fo...

Contract Data Science Robotics Ai

$401k* · Senior Fully remote

Apply

Who We Are: Delta Electronics is a global innovator at the forefront of technologies powering the future. Since 1971,...

Fulltime Remote Ai

Fully remote

Apply

We are seeking a highly skilled and experienced Development Engineer to join our Master Data Management (MDM) team. T...

Data Science Data Engineer Ai

Fully remote

Apply

Today Public Trust Unspecified None IT - Software Reston, VA (ON-SITE/OFFICE) AI/ML Developer Location: Reston, VA. R...

Ai Ai Engineer Machine Learning Deep Learning

$401k* · Senior Fully remote

Apply

Today Public Trust Unspecified None IT - Software Dallas, TX (ON-SITE/OFFICE) AI/ML Developer Location: Dallas, TX. R...

Ai Ai Engineer Machine Learning Deep Learning

$401k* · Senior Fully remote

Apply

Title: AI Systems Engineer Location: FULLY remote! Salary: $175k-$250k base + RSUs + Full Benefits Requirements: 3+ y...

Fulltime Remote Ai Machine Learning

$175k - $250k · Senior Fully remote

Apply

Artificial Intelligence Engineer Location: Boston/Hybrid Type: Full-time The Role We’re looking for a hands-on AI Sys...

Fulltime Ai Ai Engineer Machine Learning

Fully remote

Apply

Specialty/Competency: Data, Analytics & AI Industry/Sector: Not Applicable Time Type: Full time Travel Requirements: ...

Fulltime Ai Generative Ai Data Engineer

$77k - $202k · Senior Fully remote

Apply

About Fluix FLUIX is building the AI Operating System for data centers. We deploy autonomous AI that optimizes, predi...

Fulltime Ai Ai Engineer Machine Learning

Fully remote

Apply

Analyst / Systems Engineer LOCATION Aurora, CO 80014 CLEARANCE TS/SCI Full Poly (Please note this position requires f...

Fulltime Data Science Ai

$401k* · Senior Fully remote

Apply

This position is hybrid and sits within our Product Development division, which develops, tests, and improves our sof...

Fulltime Remote Ai Machine Learning

Fully remote

Apply

GovCIO is currently hiring a senior-level Zero Trust Data Analytics Engineer to join our team, supporting a critical ...

Fulltime Remote Machine Learning Data Science

$95k - $130k · Senior Fully remote

Apply

Technical Product Management Intern, Agentic AI Foster City, CA Zoox Internships – Product / Internship/Co-op / Hybri...

Product Manager Non Tech Ai Intern

$5k - $7k · Senior Fully remote

Apply

We are looking for engineers to design, implement, and develop test applications across Exadata, OCI, and other cloud...

Fulltime Ai

Fully remote

Apply

Rubrik is looking for Inside Sales Engineers. As an Inside Sales Engineer, you will receive on the job training with ...

Remote Ai Data Science

$70k - $112k · Senior Fully remote

Apply

Meta is seeking an Supply Chain Operations Engineer to join the Infrastructure Supply Chain and Engineering team to f...

Ai Machine Learning

$147k - $208k · Senior Fully remote

Apply

As the Mechanical & Controls Systems Engineering Director, you will lead, drive and execute on our strategy to engine...

Remote Ai Machine Learning

$253k - $319k · Senior Fully remote

Apply

Technical Lead L1 Req Id: 111442 City: Austin State/Province: Texas Posting Start Date: 11/16/25 Wipro Limited (NYSE:...

Data Science Data Engineer Ai

$60k - $135k · Senior Fully remote

Apply

C++ Software Engineer - GPU Performance Foster City, CA / Seattle, WA / Boston, MA / San Diego, CA Software – C++ Sof...

Gpu Cuda Ai C

$168k - $239k · Senior Fully remote

Apply

Staff Product Manager - AI Foundations San Francisco Product – Product / Full-time / Hybrid Apply for this job We bel...

Ai Product Manager Non Tech

$202k - $330k · Senior Fully remote

Apply

We're cultivating a culture that prioritizes innovators, risk-takers, and imaginative thinkers. In pursuit of becomin...

Ai Data Science Generative Ai

$197k - $265k · Senior Fully remote

Apply

Type of Requisition: Regular Clearance Level Must Currently Possess: Top Secret Clearance Level Must Be Able to Obtai...

Fulltime Ai Machine Learning Data Science

$166k - $224k · Senior Fully remote

Apply

What You Can Expect We're seeking an experienced AI Engineer specialized in agent orchestrator design and implementat...

Fulltime Remote Ai Ai Engineer

$151k* · Senior Fully remote

Apply

Responsibilities At Howmet Aerospace, we’re always in airplane mode! Our global teams are passionate about engineered...

Fulltime Remote Ai Data Science

$41k - $45k · Senior Fully remote

Apply

Showing 26–50 of 3,179 AI roles

1 3 … 128

Selected role

AI Engineer AI System Calibration Optimization

Robots & Pencils Seattle, WA

Live

Full-time Posted 16 days ago 5 min read

Robots & Pencils is seeking an outcome-oriented AI Engineer to partner with a strategic client on a high-impact AI system calibration and optimization engagement. You'll embed directly with the client's AI and product engineering teams to improve the accuracy, reliability, and transparency of their Azure-hosted, fine-tuned GPT model through systematic prompt optimization and RAG calibration.

As an AI Engineer, you'll serve as technical thought partner, actively coding and leveraging your software engineering experience to build calibration pipelines, optimize prompts using prompt optimization frameworks, and establish repeatable improvement workflows. You'll work on-site with the client, driving measurable outcomes that maximize their AI system performance.

Key Responsibilities Client Engagement & Solution Development

Embed with strategic client as their technical partner for AI system calibration and prompt optimization.
Build production-grade calibration systems using Python within the client's Azure environment.
Implement DSPy framework and GEPA optimizer to systematically improve prompt quality and retrieval performance.
Design and develop Golden Dataset curation workflows using Azure Data Labeling, establishing gold/silver data tier schemas.
Create evaluation frameworks to measure model accuracy, precision/recall, latency, and hallucination rates.
Architect prompt optimization pipelines for retrieval, context synthesis, and answer generation tailored to client needs.
Own the path to production - evaluation pipelines, Azure ML workflows, KPI dashboards, and optimization automation.
Iterate rapidly based on client feedback and KPI results, translate business goals into technical calibration improvements.

Outcome Ownership & Business Impact

Own end-to-end delivery of calibration systems from initial baseline to production-ready optimization workflows.
Establish measurable KPIs and demonstrate accuracy improvements, latency reduction, and hallucination mitigation.
Provide strategic guidance on RAG architecture improvements and retrieval parameter optimization.
Accelerate client time-to-value through hands-on development and comprehensive knowledge transfer.
Deliver operational playbooks and documentation enabling the client team to maintain calibration systems independently.

Engineering Leadership & In-Field Delivery Excellence

Lead complex, multi-stakeholder calibration initiatives on-site and remotely; drive clarity, remove blockers, and keep execution on track.
Set coding standards and architectural patterns for calibration components; write clear docs, runbooks, and technical specifications.
Mentor client engineers through code reviews, pairing sessions, and technical workshops on DSPy, GEPA, and evaluation best practices.
Make sound tradeoffs under real-world constraints - Azure cost optimization, data quality, performance requirements, and security.
Align delivery with Robots & Pencils' responsible AI practices and client governance requirements.

Cross-Functional Collaboration

Work closely with client's AI SMEs and product engineering teams to understand product catalog structure and validation workflows.
Collaborate with internal R&P product, engineering, and delivery teams on calibration methodology and best practices.
Share insights from client engagement to improve R&P's prompt optimization frameworks and tooling.
Contribute reusable patterns, evaluation frameworks, and documentation back to R&P's core platform.
Collaborate across time zones with distributed teams.

Required Skills & Qualifications

Bachelor's degree in computer science, Engineering, or equivalent experience.
7+ years of professional software development with significant ownership of architecture and delivery.
3+ years of Python in ML/AI systems with a strong focus on data processing and evaluation pipelines.
2+ years building with Generative AI including hands-on prompt engineering and optimization work.
Experience with prompt optimization frameworks - DSPy strongly preferred, or similar systematic approaches to prompt improvement.
Deep understanding of RAG architectures - retrieval quality, latency/cost tuning, hallucination mitigation, and evaluation methods.
Hands-on experience designing evaluation metrics and building assessment frameworks for LLM systems.
Knowledge of systematic experimentation methods - A/B testing, parameter tuning, performance benchmarking.
Experience with data curation, labeling workflows, and dataset quality management for AI systems.
Strong Azure cloud experience with focus on AI/ML services - Azure Machine Learning, Azure AI Search, Azure OpenAI Service.
Experience with Azure Data Labeling, Azure Blob Storage, and Azure infrastructure fundamentals.
Understanding vector search platforms and retrieval optimization (Azure AI Search, Weaviate, Qdrant, Pinecone).
Strong IaC background (Terraform or ARM templates) plus containerization and distributed systems knowledge.
Solid SDLC practices - testing strategies, CI/CD, code reviews, observability, and operational excellence.
Upper-intermediate English for client communication.
Experience leading complex technical projects with multiple stakeholders.
Strong communication skills for technical and executive audiences.
Ability to context-switch and adapt to client environments.
Willingness to travel to client sites.

Nice to Have

Direct hands-on experience with DSPy framework and GEPA optimizer.
Understanding systematic optimization principles: evolutionary algorithms, Bayesian optimization, multi-objective optimization, and Pareto efficiency concepts.
Familiarity with prompt optimization frameworks and methods - experience with any of: MIPROv2, TextGrad, EvoPrompt, AutoPrompt, or reinforcement learning approaches (GRPO, PPO).
Experience with LLM-as-judge patterns and automated evaluation pipelines.
Knowledge of advanced RAG patterns - Adaptive RAG, Self-RAG, Corrective RAG - and retrieval evaluation methods (MRR, NDCG, precision@k).
Understanding of agentic AI patterns - ReAct, Chain-of-Thought, Tool Use - and their application in RAG systems.
Experience building evaluation dashboards with Azure Monitor, Application Insights, or similar observability tools.
Familiarity with MLOps practices - model versioning, experiment tracking, metric logging for evaluation systems.
Experience with AWS or GCP AI/ML platforms (Bedrock, SageMaker, Vertex AI) and cross-cloud architecture patterns.
Experience with product catalog systems, cross-reference matching, or e-commerce search optimization.
Background in manufacturing, industrial equipment, or technical specification systems.
Prior consulting or professional services experience with enterprise clients.

Personal Competencies

Accountability – Owns full client engagement cycle with quality, reliability, and attention to detail.
Adaptability – Thrives in dynamic, fast-paced client environments.
Collaboration – Builds strong partnerships across teams and time zones.
Execution-Focused – Delivers maintainable, scalable solutions without overengineering.
Innovation-Minded – Brings curiosity and experimentation to technology decisions.
Craftsmanship – Cares deeply about documentation and code quality, architecture, and user experience.

Why Join Robots & Pencils? We don't just ship features, we build digital-first products that matter. As a Senior Forward Deploy Engineer, you'll join a team that values deep craft, cross-functional collaboration, and relentless focus on quality. You'll work on impactful agentic AI applications using modern technologies, while influencing engineering culture and best practices across the organization.

Ready to apply? You'll go straight to the hiring team.

No agency in the middle · Your profile is shared privately.

Explore the complete AI ecosystem

Discover the best AI-first companies, podcasts, events, learning paths, and jobs in one focused hub.

AI Learning Hub · Always curated, never noisy

Simple pricing for serious AI hiring

Pay per listing. No subscriptions, no hidden fees. Designed for teams hiring for high-impact AI roles.

No-risk: replace or refund if the role doesn’t get traction.

Standard listing

Reach active AI talent

For startups

$349 per role

30-day live listing in the AI job feed.
Structured posting written for AI engineers (we’ll help refine copy).
Instant alerts to subscribed candidates for your tags (LLMs, agents, infra, etc.).

Most teams see first applicants within 24–48 hours.

Max visibility to senior talent

For scale-ups

$649 per role

Everything in Standard, plus homepage & “Featured role” placement.
Priority placement in weekly AI roles newsletter.
1:1 review of your role with DevFound to calibrate for top-tier candidates.
Highlight badge on job page to increase conversion.

Best for teams hiring 1–3 critical AI roles this quarter.

What an AI Developer does?

▼

An AI developer is someone who creates and builds artificial intelligence systems

Their responsibilities may include designing and implementing algorithms, creating and training machine learning models, and deploying AI systems to solve practical problems

Additionally, they may be responsible for maintaining and improving existing AI systems, as well as collaborating with other teams or individuals to integrate AI technology into larger systems.

AI Jobs

Explore AI roles

AI Engineer AI System Calibration Optimization

Equipment Tool Design Engineer 4 contract

Field Service Engineer Dallas DFW Metroplex

Lead Data Engineer Supply Chain

AI ML Developer 101867

AI ML Developer

REMOTE AI Systems Engineer HPC

AI Systems Engineer

GenAI Python Systems Engineer – Senior Associate

AI ML Engineer RL Physical Systems

Analyst Systems Engineer

Machine Learning Engineer Associate

Senior Zero Trust Data Analytics Engineer

Technical Product Management Intern Agentic AI

Software Developer

Inside Sales Engineer Remote

Supply Chain Operations Engineer

Director Mechanical Controls Systems Engineering

Technical Lead L1

C++ Software Engineer GPU Permance

Staff Product Manager AI Foundations

Staff Software Engineer

SCITLS Lead Data Scientist Task Lead

AI Engineer Agent Automation

Intern Artificial Intelligence AI

Explore the complete AI ecosystem

Choose Your Plan

Simple pricing for serious AI hiring

Reach active AI talent

Max visibility to senior talent

What an AI Developer does?