Skip to content

ALFWorld

ALFWorld is an AI benchmark; this page records what it measures and traces its data, grader, and scores to primary sources.

Measures agents that learn high-level policies in text environments and execute the same household goals in embodied worlds.

Address
Online, Global
Tags
Helpful, Science
Category
Agents
Status
Active
Data licence
MIT
Data access
open
Grader
simulation
Organization
ALFWorld authors
Released
2020-10
Top-score provenance
unknown
ABI family
No

Questions

Where is ALFWorld?

ALFWorld is at Online, Global.

How do I contact ALFWorld?

To contact ALFWorld, visit https://github.com/alfworld/alfworld.

More benchmarks in Online

  • SafetyOnline

    AdvBench

    Measures whether adversarial suffixes induce aligned language models to produce targeted harmful behavior.

    Task count
    520
  • AgentsOnline

    AgentBench

    Measures language-model agents across operating systems, databases, games, web shopping, and other interactive environments.

    Task count
    8
  • SafetyOnline

    AgentDojo

    Evaluates agent task utility and resistance to prompt injection while agents use tools over untrusted data.

    Task count
    97
  • ReasoningOnline

    AGIEval

    Tests general problem solving with questions from 20 public admission, qualification, and competition exams.

    Task count
    20
  • AgentsOnline

    AI2-THOR

    Evaluates embodied agents in interactive simulated indoor scenes with object manipulation and navigation.

  • ReasoningOnline

    AlpacaEval

    Measures instruction-following quality by comparing model responses against references with automated preference judges.

    Task count
    805
All benchmarks in Online

Published by . How we check each benchmark.