Explore AI roles

Keyboard friendly • Copy, share & save roles

Sort by

Data Scientist (AI Task Evaluation & Statistical Analysis Specialist) Hourly Contract | Part-Time Remote | $100 –$120...

Parttime Remote Ai Ai Engineer

$208k - $249k · Senior Fully remote

Apply

Exceptional Software Engineers (Experience Using Agents) Hourly Contract | Remote | $85 per hour About the Role Merco...

Parttime Remote Ai Ai Engineer

$145k - $228k · Senior Fully remote

Apply

Data Science Expert Hourly Contract | Part-time Remote (US) $80 –$120 per hour A leading AI research initiative is se...

Remote Scientist Data Science Hr

$249k* · Senior Fully remote

Apply

Selected role

Data Scientist PartTime Remote $100 –$120 hr

Call For Referral

Live

$208k - $249k · Senior Full-time Posted 24 days ago 3 min read

**Data Scientist (AI Task Evaluation & Statistical Analysis Specialist)**

**Hourly Contract | Part-Time Remote | $100 –$120 per hour**

**1. About the Role**

Mercor is partnering with a
**leading AI research lab**
to hire experienced
**Data Scientists**
specializing in
**AI task evaluation and statistical analysis**
.

In this role, you will conduct
**comprehensive failure analysis**
on AI agent performance across finance-sector tasks — identifying systemic patterns, diagnosing performance bottlenecks, and improving model evaluation frameworks.

You’ll work closely with AI engineers and research analysts to transform raw evaluation data into actionable insights, strengthening the quality, fairness, and reliability of large-scale AI systems.

**2. Key Responsibilities**

* **Statistical Failure Analysis:**
Identify recurring patterns in AI agent failures across task components (prompts, rubrics, file types, tags, etc.).
* **Root Cause Analysis:**
Determine whether issues stem from
**task design**
,
**rubric clarity**
,
**file complexity**
, or
**agent limitations**
.
* **Dimensional Analysis:**
Examine performance variations across
**finance sub-domains**
, file structures, and evaluation criteria.
* **Visualization & Reporting:**
Build
**dashboards and analytical reports**
that highlight edge cases, performance clusters, and opportunities for improvement.
* **Framework Enhancement:**
Recommend refinements to
**rubric design, evaluation metrics, and task structures**
based on empirical findings.
* **Stakeholder Communication:**
Present key insights to
**data labeling teams, ML engineers, and research collaborators**
.

**3. Required Qualifications**

* Strong foundation in
**statistical analysis, hypothesis testing, and pattern recognition**
.
* Proficiency in
**Python**
(pandas, scipy, matplotlib/seaborn) or
**R**
for data analysis.
* Hands-on experience with
**exploratory data analysis (EDA)**
and
**feature interpretation**
.
* Understanding of
**AI/ML evaluation methodologies**
and
**LLM performance metrics**
.
* Skilled in using
**Excel**
,
**SQL**
, and
**data visualization tools**
(e.g., Tableau, Looker).

**4. Preferred Qualifications**

* Experience with
**AI/ML model evaluation**
or
**quality assurance pipelines**
.
* Background in
**finance**
or interest in learning financial domain structures.
* Familiarity with
**benchmark datasets**
,
**failure mode analysis**
, and
**evaluation frameworks**
.
* **2–4 years**
of relevant professional experience in data science, analytics, or applied statistics.

**5. More About the Opportunity**

* **Commitment:**
Part-time, 20–25 hours/week
* **Schedule:**
Fully remote and asynchronous — work on your own time
* **Duration:**
1–2 months, with strong potential for extension
* **Start Date:**
Immediate

**6. Compensation & Contract Terms**

* **Hourly Rate:**
$100–$120/hour (based on experience and region)
* **Classification:**
Independent Contractor (via Mercor)
* **Payments:**
Weekly via
**Stripe Connect**
for approved work

⚡
**PS: Mercor reviews applications daily. Please complete your interview and onboarding steps to be considered for this opportunity.**
⚡

Ready to apply? You'll go straight to the hiring team.

No agency in the middle · Your profile is shared privately.

Explore the complete AI ecosystem

Discover the best AI-first companies, podcasts, events, learning paths, and jobs in one focused hub.

AI Learning Hub · Always curated, never noisy

Simple pricing for serious AI hiring

Pay per listing. No subscriptions, no hidden fees. Designed for teams hiring for high-impact AI roles.

No-risk: replace or refund if the role doesn’t get traction.

Standard listing

Reach active AI talent

For startups

$349 per role

30-day live listing in the AI job feed.
Structured posting written for AI engineers (we’ll help refine copy).
Instant alerts to subscribed candidates for your tags (LLMs, agents, infra, etc.).

Most teams see first applicants within 24–48 hours.

Max visibility to senior talent

For scale-ups

$649 per role

Everything in Standard, plus homepage & “Featured role” placement.
Priority placement in weekly AI roles newsletter.
1:1 review of your role with DevFound to calibrate for top-tier candidates.
Highlight badge on job page to increase conversion.

Best for teams hiring 1–3 critical AI roles this quarter.

Call For Referral Jobs

Explore AI roles

Data Scientist PartTime Remote $100 –$120 hr

AI Engineer Remote Up to $85 hr

Data Scientist Remote PartTime $80 –$120 hr

Explore the complete AI ecosystem

Choose Your Plan

Simple pricing for serious AI hiring

Reach active AI talent

Max visibility to senior talent