{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"35a3412e-1733-5b59-90ea-f7e17c5e6087","task_key":"default--validation--45461","task_revision_id":"1","upstream_id":"45461","short_description":"HellaSwag validation 45461","config":"default","split":"validation","body":"{\"activity_label\":\"Home and Garden\",\"ctx\":\"[header] How to find a local freecycle group [title] Search for a group on the freecycle network. [step] One of the oldest and most common freecycle organizations is the freecycle network. It's a nationwide database that connects people to their local freecycle group.\",\"endings\":\"['Search through the full list of the groups and networks to see what groups are in your area. It\\\\'s usually easier to find groups in your area by searching online for \\\" freecycle \\\" and then \\\" freecycle.', 'On the homepage, enter your city and state. From there, the page will direct you to a listing of all the cities in the area.', \\\"To find a group, look on freecycle's website at. [substeps] The network's search function is located at https: // www.freecyclefororg/groups/group/start a search engine at https: // www.freecyclecle.\\\", '[substeps] Visit the website, or type in your city or state into the provided search bar. In some cases, you may be able to find groups without a specific title, such as local freecycle.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}