{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7b33f4fe-08f2-5542-b7c4-fe62a7c650e1","task_key":"default--validation--19734","task_revision_id":"1","upstream_id":"19734","short_description":"HellaSwag validation 19734","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to make studying the bible more interesting for young teens [title] Start off with a quick game. [step] A game can wake everyone up and break the ice. The game doesn't even have to relate to the same topic as the bible study; however, it can add a fun element to the lesson, if it does.\",\"endings\":\"['[substeps] If you want to play a game that relates to the lesson, try to incorporate the main theme of the story topic into the game. For instance, if your bible passage has to do with trusting god, consider doing trust falls using \\\" spotters \\\" to push them back up for instance.', 'Set the cards aside and have each person have one card count up. Whoever gets the highest number, and the better score, wins.', '[substeps] You can test out a game on a cd or the internet. Begin with a simple game like \\\" look at the universe, \\\" or the bible symbol.', '[substeps] Choose a toy to play with your younger kid, or a game that relaxes your kid. The game will spread ideas over time, making up for lost points.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}