{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"41115dce-89ec-58f1-ad16-b9526dace03b","task_key":"default--validation--34422--variant-bb6b49707411","task_revision_id":"1","upstream_id":"34422--variant-bb6b49707411","short_description":"HellaSwag validation 34422","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to get kids to listen without repeating yourself [title] Create and write down rules of behavior. [step] Kids are more likely to follow directions when there are clear rules that have been written down and discussed beforehand. Make a point to create house rules that help to guide your kids.\",\"endings\":\"[\\\"[substeps] Make a list of rules that you'd like to follow and talk them over with your kids. This helps provide an example that you could adjust the following behaviors: ignoring your guests, making noise, calling attention to noise, or popping or stomping on dishes around the house.\\\", 'Consider using popsicle sticks or another object to encourage your kids to follow their behavior instead of repeating themselves. [substeps] Create reminders about parents and restrictions on who they can invite, including rules like \\\" do not touch the fridge \\\".', '[substeps] Make sure the rules are clear so they know what can and cannot be said. As an example, \\\" no tv using a portable device during playtime in the dark \\\" is a better rule than \\\" no texting in the garage or rooms until curfew.', \\\"This way, when they aren't listening, you can refer back to the rules already set in place. [substeps] Consider posting on a whiteboard in a family room, kitchen, or open area of the house about rules.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}