{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2f306c8c-1101-5c30-85d7-344c071b84fe","task_key":"default--validation--19402","task_revision_id":"1","upstream_id":"19402","short_description":"HellaSwag validation 19402","config":"default","split":"validation","body":"{\"activity_label\":\"Travel\",\"ctx\":\"[header] How to have fun in a hotel room [title] Play board or card games. [step] If you're not alone in the hotel room, and especially if you're there with children, a board game can be a lot of fun. [substeps] Even if you're alone, you could play a game.\",\"endings\":\"['Games like monopoly, soccer, chess, or potato chips will give you lots of clear ideas of which activities are great for your family. If you\\\\'re at your own house, you could put the cards in a bowl of \\\" cheat sheets \\\" or punch balloons to do games.', \\\"For instance, making a puzzle in a large game cabinet or finding your room's coffee table works great. [title] Climb, climb, and play a board game.\\\", \\\"You don't have to be too young to play on your own in real life. If there's enough white noise or other distractions around, enjoy running around with your board or card game playing cards.\\\", 'If you have a deck of cards, try solitaire! You could also play solitaire online. There are many card games you can play if other people are in the room, like poker or gin rummy.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}