Board Game Reasoning Expert (AI Training & Evaluation)

About Turing
Turing is one of the world’s fastest-growing AI companies, accelerating the advancement and deployment of powerful AI systems. Turing helps leading AI labs improve the reasoning, problem-solving, and decision-making capabilities of large language models (LLMs) through high-quality human feedback, evaluation, and training data.

Role Overview
We are seeking Board Game Reasoning Experts to help train and evaluate next-generation AI models. In this role, you will leverage your expertise in board games, game mechanics, strategic reasoning, probability, and complex rule systems to create, review, and evaluate high-quality datasets that improve AI performance.
You will work on challenging tasks involving game logic, decision-making, strategic planning, rule interpretation, and scenario analysis, helping frontier AI systems develop stronger reasoning capabilities.

What Does Day-to-Day Look Like?

• Create and review game-based reasoning tasks designed to evaluate AI systems.

• Analyze board game scenarios, strategic decision trees, and rule-based systems.

• Evaluate AI-generated responses for correctness, consistency, and reasoning quality.

• Develop prompts, rubrics, and evaluation guidelines for board game and strategy-focused tasks.

• Identify logical errors, rule violations, and flawed reasoning in AI outputs.

• Contribute to benchmark creation and quality assurance processes for AI evaluation projects.

- Collaborate with project teams to improve dataset quality and evaluation methodologies.
Requirements
Required Qualifications

• Bachelor's degree in Computer Science, Mathematics, Cognitive Science, Game Design, Philosophy, Economics, or a related analytical field.

• 2+ years of professional or semi-professional experience in board game design, playtesting, tabletop game communities, or related strategy-focused environments.

• Strong understanding of logic, probabilistic reasoning, game mechanics, and complex rule systems.

• Background in game theory, behavioral economics, decision science, or formal logic.

• Familiarity with modern board games, trading card games (TCGs), tabletop RPGs, strategy games, or competitive game systems.

• Strong analytical and problem-solving skills.

- Excellent written communication skills.

• Excellent written communication skills.

• Prior experience in data annotation, AI training, prompt engineering, QA, game design, puzzle design, or rules-based system analysis.

• Experience creating evaluation rubrics, benchmark datasets, or quality assurance frameworks.

• Experience with Python, SQL, or data analysis tools.

• Experience working on RLHF, model evaluation, synthetic data generation, or LLM benchmarking projects.

- Familiarity with recently released strategy or tabletop games and the ability to quickly learn new rule systems.

• Familiarity with recently released strategy or tabletop games and the ability to quickly learn new rule systems.

• Work in a fully remote environment.

- Opportunity to work on cutting-edge AI projects with leading LLM companies.

• Opportunity to work on cutting-edge AI projects with leading LLM companies.

• Commitments Required: At least 4 hours per day and minimum 20 hours per week with overlap of 4 hours with PST.

• Engagement type : Contractor assignment (no medical/paid leave)

- Duration of contract : 2 months; [expected start date is next week]

• Duration of contract : 2 months; [expected start date is next week]

• Take home Assessment