Remote Otter LogoRemoteOtter

Data Analyst for AI Performance Evaluation - Remote

Posted 2 days ago
Data Analysis
Contract
USA

Overview

We're seeking a data-driven analyst to conduct comprehensive failure analysis on AI agent performance across finance-sector tasks. You'll identify patterns, root causes, and systemic issues in our evaluation framework by analyzing task performance across multiple dimensions (task types, file types, criteria, etc.).

In Short

  • Conduct statistical failure analysis on AI agent performance.
  • Identify root causes of failures in task design and evaluation criteria.
  • Analyze performance variations across finance sub-domains.
  • Create dashboards and reports for performance insights.
  • Recommend improvements based on statistical findings.
  • Communicate insights to stakeholders effectively.

Requirements

  • Strong foundation in statistical analysis and hypothesis testing.
  • Proficiency in Python or R for data analysis.
  • Experience with exploratory data analysis.
  • Understanding of AI/ML evaluation methods.
  • Comfortable with data visualization tools and SQL.
  • 2-4 years of relevant experience in data analysis.

Benefits

  • Opportunity to work on cutting-edge AI projects.
  • Collaborate with experts in the finance sector.
  • Access to professional development resources.
  • Flexible working environment.
  • Competitive salary and benefits package.
Mercor logo

Mercor

HelixRecruit is a forward-thinking recruitment firm specializing in connecting talent with innovative companies. They focus on providing opportunities for individuals to engage in data annotation projects that enhance artificial intelligence systems. With a commitment to flexibility, HelixRecruit offers remote and asynchronous work arrangements, allowing contractors to set their own schedules while contributing to meaningful projects. The company values detail-oriented generalists and encourages applicants from diverse educational backgrounds, including students and early career professionals.

Share This Job!

Save This Job!

Similar Jobs:

AvantStay logo

Performance Data Analyst - Remote

AvantStay

38 weeks ago

AvantStay is looking for a Performance Data Analyst to optimize listings and enhance performance through data analysis.

Worldwide
Full-time
Data Analysis

Ylopo

Performance Data Analyst - Remote

Ylopo

47 weeks ago

Join Ylopo as a Performance Data Analyst to drive performance improvements through data analysis and KPI development.

Worldwide
Full-time
Data Analysis
60,000PHP/month
AccorCorpo logo

ESG Data & Performance Analyst - Remote

AccorCorpo

9 weeks ago

Join Accor as an ESG Data & Performance Analyst to manage non-financial performance and support sustainability initiatives.

France
Full-time
Data Analysis
Activate Talent logo

Senior Performance Data Analyst - Remote

Activate Talent

34 weeks ago

Join a fast-growing company as a Senior Performance Data Analyst, transforming raw data into valuable business insights.

Mexico
Full-time
Data Analysis

V.O.I.D.V

Performance Marketing Data Analyst - Remote

Vicar Operating, Inc. dba VCA

19 weeks ago

The Performance Marketing Data Analyst will analyze data to enhance marketing strategies and drive demand generation.

CA, USA
Full-time
Data Analysis
$81,000 - $117,000/year