{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"19340ae2-42ae-537b-859d-f51826e9bc12","task_key":"default--validation--36247","task_revision_id":"1","upstream_id":"36247","short_description":"HellaSwag validation 36247","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to shower after gym class while on your period [title] Know the rules at your school. [step] In some cases you may be required to shower after gym class, but in other cases it may be optional. Find out what the policy is at your school and whether they are willing to make exceptions.\",\"endings\":\"[\\\"[title] Check with your school's gym clothes department if school policies have been violated. [step] In some cases you may be expected to wear loose clothing while you are on your period, but if you are allowed to be in your underwear at all times during classes, this might be a way of breaking the rules.\\\", '[substeps] This may depend on the rules of your school. Usually, schools will only allow you to shower with your period if you are physically fit and look clean.', \\\"[substeps] If they don't let you shower after gym class, you may never be allowed to take showers unless you have a new tampons or have been distracted by a new case of infection during class. During regular class periods, look for the rules in your school newspaper or an online forum that lists the rules.\\\", '[substeps] Be sure to consider that you may be sweaty and smelly if you choose not to shower after gym class. Choosing not to shower works best if the activities during class do not cause you to sweat much or if you have gym at the end of the day.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}