[Remote] AI Prompt Engineer – HLE (Humanity’s Last Exam

Remote Full-time
Note: The job is a remote job and is open to candidates in USA. MyRemoteTeam Inc is building elite teams to evaluate and advance the next generation of GenAI models. The AI Prompt Engineer will review and refine prompts, analyze model responses, and collaborate with researchers to create evaluation frameworks, ensuring high-quality outputs and human reasoning alignment. Responsibilities • Review, analyze, and refine prompts used to train cutting-edge GenAI systems. • Decide which model responses are correct, incorrect, higher quality, or more aligned with human reasoning. • Work with GenAI researchers & engineers to understand evaluation goals and data workflows. • Convert high-level requirements into clear, detailed evaluation frameworks. • Create research-backed, high-difficulty questions that challenge AI models ("Humanity’s Last Exam" style). • Conduct deep research using large language models and trusted sources. • Innovate new prompt strategies and evaluation rubrics. • Ensure factual accuracy, recall, precision, and bias-free content. • Maintain extremely high quality while working with minimal supervision. Skills • Review, analyze, and refine prompts used to train cutting-edge GenAI systems. • Decide which model responses are correct, incorrect, higher quality, or more aligned with human reasoning. • Work with GenAI researchers & engineers to understand evaluation goals and data workflows. • Convert high-level requirements into clear, detailed evaluation frameworks. • Create research-backed, high-difficulty questions that challenge AI models ('Humanity’s Last Exam' style). • Conduct deep research using large language models and trusted sources. • Innovate new prompt strategies and evaluation rubrics. • Ensure factual accuracy, recall, precision, and bias-free content. • Maintain extremely high quality while working with minimal supervision. • Strong writing and content development experience. • Ability to design complex, original problems across your domain. • Deep research and fact-checking ability. • A unique human voice — no AI-style mimicry. • Precision, logic, and top-tier attention to detail. • Strong prompt engineering skills (few-shot, chain-of-thought, reasoning prompts, etc.). • Familiarity with LLM behavior, limitations, and error patterns. • Experience using AI tools for research and refinement. • Ethical understanding of bias mitigation and responsible AI usage. • Solid data literacy for LLM training workflows (cleaning, verification, preparation). • Master’s with distinction or PhD preferred. • Fields: Finance, Engineering, Physics, Chemistry, Medicine. • Bachelor’s degree accepted with proven advanced experience. • Graduated from leading US or international institutions (preferred). Company Overview • MyRemoteTeam.com is a quick & easy way for Businesses to Pay Remote Teams, Employees, Consultants & Freelancers. It was founded in 2017, and is headquartered in Claymont, Delaware, USA, with a workforce of 11-50 employees. Its website is Apply tot his job
Apply Now →

Similar Jobs

AI Content Strategist / Prompt Engineer (W2 role)

Remote Full-time

[Remote] QA Engineer Specialist

Remote Full-time

Freelance Civil Engineering - Quality Assurance (AI Trainer)

Remote Full-time

Senior Prompt & QA Engineer for fast-growing AI healthcare startup

Remote Full-time

QA Analyst – AI Solutions (Portugal-based Remote/Hybrid)

Remote Full-time

Senior Mobile QA Engineer

Remote Full-time

Head of QA, Release Engineer

Remote Full-time

Manual QA (AI & Data Privacy)

Remote Full-time

Data Scientist - AI Agent

Remote Full-time

Research Scientist (AI) - Science Team

Remote Full-time

[FULL TIME Remote] (Entry Level/No Experience Required) Walmart

Remote Full-time

Experienced Customer Experience and Partnership Specialist for Innovative Family Platform - Remote Opportunity at blithequark

Remote Full-time

Experienced Customer Service Agent – Remote Cargo Operations and Client Support Specialist at arenaflex

Remote Full-time

Remote APC (PA or NP) - Population Health |Optum CA

Remote Full-time

Search Engine Marketing (SEM) Analyst

Remote Full-time

Online Employee Relations Specialist

Remote Full-time

Experienced Remote Data Entry Specialist – Entry Level Opportunity in Paraguay for Ambitious and Customer-Oriented Individuals

Remote Full-time

Executive Advisor

Remote Full-time

Metadata Associate

Remote Full-time

Experienced Full-Time Remote Live Chat Support Specialist – Delivering Exceptional Customer Service and Technical Support to Clients Across the Globe

Remote Full-time
← Back to Home