{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e1d98f84-55b0-5ab4-8829-2ae334c9409c","task_key":"default--validation--27973","task_revision_id":"1","upstream_id":"27973","short_description":"HellaSwag validation 27973","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to determine your body shape [title] Pay attention to where you gain weight. [step] Each body type is prone to weight gain in a specific area-for example, the thighs or stomach. Know where you gain weight most often to clue yourself in about your shape.\",\"endings\":\"['What parts of your body determine your body shape? [substeps] Body mass index (bmi). Bmi is your height and you weigh between 135 and 140 kilograms (35 and 200 kg).', 'How does it affect your figure? [substeps] Be aware that your body size can also affect your weight. People with denser or heavier bodies are more likely to gain weight than people with a smaller or heavier body.', '[title] Stand in front of a mirror while wearing as little as possible. [step] Clothing can mask your shape, making it harder for you to get an accurate picture of your curves.', \\\"[substeps] Young adults generally weigh about 170 pounds when they're in their mid-teens , 55 pounds when they're in their twenties, and up to 65 pounds at their maximum before adulthood. Men typically weigh 150 pounds when they start puberty, and at 40, the average for children aged 45 to 55 is 18.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}