Role overview
Who is Authenticx?
Authenticx is on a mission to help humans understand humans. Our software platform is the new standard for humanizing customer interaction data at scale. We do this by channeling our passion and talent into helping health care leaders listen to their conversational data in a way that delivers value to the enterprise.
What you'll work on
- Design and implement sophisticated LLM prompts aligned to internal scoring rubrics and customer-specific needs.
- Conduct prompt testing and evaluation using labeled datasets to ensure performance accuracy.
- Collaborate with engineering to improve tooling and infrastructure for managing LLM scoring workflows.
- Maintain a centralized prompt library to ensure reuse and standardization across use cases.
- Document prompt strategies, testing approaches, and outcomes for internal learning.
- Identify and resolve inefficiencies in the prompt development and deployment process.
- Partner with product and data labeling teams to improve the quality and consistency of scoring outputs.
What we're looking for
- Experience in structured data labeling or QA workflows.
- Familiarity with tools like LangChain, OpenAI/GPT APIs, or vector databases.
- Background in linguistics, cognitive science, or HCI.
- Proficiency in Python or scripting tools for evaluation or automation.
May include occasional travel for team meetings or planning sessions.
Must be authorized to work in the U.S. without current or future visa sponsorship.
Tags & focus areas
Used for matching and alerts on DevFound Ai Nlp Generative Ai Fulltime