{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"972dfdac-b404-517b-841a-20c8b28a0191","task_key":"default--validation--24215","task_revision_id":"1","upstream_id":"24215","short_description":"HellaSwag validation 24215","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to identify eating disorders in teenage girls [title] Look for dramatic weight changes. [step] Weight loss is common with eating disorders, especially anorexia and bulimia. Weight may drop dramatically from the starting point, or drop below a healthy weight.\",\"endings\":\"['Eating disorders may cause rapid weight gain, and this can cause other lifestyle changes, such as weight gain, independence, and toning. [substeps] Pay attention to changes to weight loss in teen girl teens who do not eat the way they did adult weight.', 'Teens may gain weight faster than their peers, or lose weight completely. [substeps] This refers to experienced eating disorder women with old family members.', 'Sadness, depression, anxiety, and a physical wellness pattern can all appear almost suddenly, and this change usually arises dramatically. [title] Get prompt help if you are struggling to learn to eat for yourself.', \\\"Conversely, those with a binge-eating disorder will gain weight rapidly. The absence of dramatic weight change should not be taken as evidence there isn't a problem.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}