Role overview
If you have a Candidate Login already, but have forgotten your password please use the steps to reset your password. If you have forgotten your email login, please contact servicedesk@welocalize.com subject Workday Candidate Login
When creating your Workday account and entering personal information like name, address, please do not use ALL CAPS.
Thank you!
NOTICE: For Privacy Policy please review here
**Job Responsibilities**
Welo Data is seeking a creative and analytical Prompt Engineer & Data Analyst
to join our team.
In this role, you will be instrumental in refining and evaluating large language models (LLMs).
You'll design prompts, create high-quality datasets, and perform rigorous analysis to directly
improve the functionality, accuracy, and safety of cutting-edge AI systems. Your expertise will
help us build smarter, more reliable, and more helpful technology.
**Key Responsibilities**
**Prompt Engineering & Model Evaluation**
* Design, test, and iteratively refine complex and creative prompts to enhance AI model
* capabilities in reasoning, instruction following, and contextual understanding.
* Conduct rigorous side-by-side (SxS) comparisons of AI-generated outputs, providing
* detailed rationales and quality ratings to identify the superior response.
* Develop "golden" datasets, ideal responses, and granular evaluation rubrics to
* serve as benchmarks for model training and performance analysis.
* Engineer adversarial prompts and red-team scenarios to systematically identify
* model vulnerabilities, biases, and safety gaps across various policies (e.g., Harassment,
* Hate Speech, Dangerous Content).
**Data Curation & Analysis**
* Create, annotate, and review diverse datasets across text, audio, and video formats to
* support model training and localization.
* Perform in-depth fact-checking and analysis to ensure model responses are accurate,
* relevant, and grounded in reliable sources.
* Establish and document style guides, content standards, and evaluation procedures
* to ensure consistency and quality across all projects.
* Analyze model outputs to identify trends, document error patterns, and categorize
* failures, providing actionable feedback to engineering teams.
**Collaboration & Training**
* Train, mentor, and guide other team members on prompt engineering best practices,
* evaluation methodologies, and quality standards.
* Collaborate with engineering and product teams to translate evaluation insights into
* actionable model improvements.
**Multimodal AI Training**
* For voice projects, script and perform dialogues portraying various personas (e.g.,
* customer, agent) and accents to generate realistic conversational data for AI voice
* agents.
* For video projects, author precise text prompts using professional video production
* terminology (e.g., shot angles, camera movements, lighting) to guide generative video
* models.
**Qualifications**
Additional Job Details:
* Bachelor's degree or equivalent experience in Linguistics, Computational Linguistics,
* Communications, Technical Writing, or a related analytical field.
* Native or near-native fluency in English with exceptional writing and editorial skills.
* Proven experience in a role involving AI data annotation, content quality review, search
* quality rating, or prompt engineering.
* A highly detail-oriented and analytical mindset, with the ability to deconstruct complex
* instructions and evaluate outputs with precision.
* Ability to interpret code, datasets, and system workflows at a conceptual level (no
* coding required).
* Ability to work independently and manage workflows effectively in a remote environment.
**Nice to Have**
* Multilingual proficiency in one or more languages in addition to English.
* Direct experience with generative AI tools for text, voice, or video.
* Background in QA testing, rubric design, or AI safety and ethics evaluation.
* Familiarity with data annotation platforms and model evaluation tools.