Skip to content

VizWiz VQA

VizWiz VQA is an AI benchmark; this page records what it measures and traces its data, grader, and scores to primary sources.

Measures answers to visual questions submitted by blind people in real accessibility scenarios.

Address
Online, Global
Tags
Helpful, Science
Category
Multimodal
Status
Active
Data licence
CC-BY-4.0
Data access
open
Grader
exact
Organization
VizWiz team
Released
2018-02
Top-score provenance
unknown
ABI family
No

Questions

Where is VizWiz VQA?

VizWiz VQA is at Online, Global.

How do I contact VizWiz VQA?

To contact VizWiz VQA, visit https://vizwiz.org/tasks-and-datasets/vqa/.

More benchmarks in Online

  • SafetyOnline

    AdvBench

    Measures whether adversarial suffixes induce aligned language models to produce targeted harmful behavior.

    Task count
    520
  • AgentsOnline

    AgentBench

    Measures language-model agents across operating systems, databases, games, web shopping, and other interactive environments.

    Task count
    8
  • SafetyOnline

    AgentDojo

    Evaluates agent task utility and resistance to prompt injection while agents use tools over untrusted data.

    Task count
    97
  • ReasoningOnline

    AGIEval

    Tests general problem solving with questions from 20 public admission, qualification, and competition exams.

    Task count
    20
  • AgentsOnline

    AI2-THOR

    Evaluates embodied agents in interactive simulated indoor scenes with object manipulation and navigation.

  • AgentsOnline

    ALFWorld

    Measures agents that learn high-level policies in text environments and execute the same household goals in embodied worlds.

All benchmarks in Online

Published by . How we check each benchmark.