{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"97165cef-c47f-5900-84ce-e2fe5335a50f","task_key":"default--validation--50423","task_revision_id":"1","upstream_id":"50423","short_description":"HellaSwag validation 50423","config":"default","split":"validation","body":"{\"activity_label\":\"Food and Entertaining\",\"ctx\":\"[header] How to find help for a suspected eating disorder [title] Be familiar with what an eating disorder is. [step] An eating disorder is a serious condition that results in severe disturbances in your eating habits. You may go through cycles of eating too much or too little, along with having an extreme preoccupation with your body or weight.\",\"endings\":\"['Eating disorders tend to apply to everyone, even because of nutrition. Eating disorders like binge eating are often treated as an aggressive disorder, such as eating a large calorie-rich diet or overly-large meals.', 'The most common eating disorders are anorexia nervosa, bulimia nervosa, and binge-eating disorder. [substeps] Researchers believe the roots of an eating disorder involve a intricate mixture of genetic, biological, psychological, social, and behavioral factors.', 'Losing weight and gaining more weight these changes may lead to a weight gain. [substeps] These changes can include eating disorders, especially diets that require less or fewer calories, or weight gain.', '[substeps] If you are unable to balance your diet and exercise habits, symptoms of an eating disorder may even increase. Eating disorders that require diagnosis include anorexia, mania, or extreme apathy.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}