What license is OSWorld: Multimodal Computer Interaction Tasks under?

OSWorld: Multimodal Computer Interaction Tasks is available under mit.

OSWorld: Multimodal Computer Interaction Tasks

Active

Tests AI agents' ability to perform realistic, open-ended tasks within simulated computer environments, requiring complex interaction across multiple input modalities.

Open

Publisher: XLANG Lab
Domain: Assistants
License: mit
Published: Jan 2025
Notable for: Benchmark for evaluating Assistants.
Canonical: github.com/UKGovernmentBEIS/inspect_evals/tree/main/src/inspect_evals/osworld

Cite

Notes

Only stored in your browser.

Attribution

README: github.com/UKGovernmentBEIS/inspect_evals/blob/main/src/inspect_evals/osworld/eval.yamlMIT

Attribution policy →

Papers

OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments

NeurIPS · 2024

Introduces OSWorld, a benchmark of 369 real tasks across Ubuntu, Windows, and macOS apps (Chrome, VS Code, GIMP, LibreOffice, Thunderbird, etc.) with execution-based scoring.

FAQ

What is OSWorld: Multimodal Computer Interaction Tasks?: Tests AI agents' ability to perform realistic, open-ended tasks within simulated computer environments, requiring complex interaction across multiple input modalities.
What license is OSWorld: Multimodal Computer Interaction Tasks under?: OSWorld: Multimodal Computer Interaction Tasks is available under mit.