{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7b63a4ad-d6f6-5e74-b1c5-78bdbdf8f11a","task_key":"default--validation--13034","task_revision_id":"1","upstream_id":"13034","short_description":"HellaSwag validation 13034","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to ease the pain of fibromyalgia [title] Eat as healthy as possible. [step] Having a poor diet may exacerbate stress and anxiety and this can stimulate pain and other symptoms of fibromyalgia. Making healthy food choices cannot only improve your overall health, but may relieve pain and other symptoms of the disorder.\",\"endings\":\"['[substeps] Start your diet by experimenting with different foods and things to find what makes you feel good. When your foods begin to be less healthy and you gain some weight, stop.', '[title] Recognize what type of diet you need. [step] There are a variety of foods that are able to ease fibromyalgia, such as : [substeps] To lose weight: choose low-fiber and low-sugar foods.', '[substeps] Consider following an anti-inflammatory diet. This can be helpful for conditions like fibromyalgia.', 'Most people including those suffering from fibromyalgia in their lives have nutrient-rich food choices available. [substeps] Keep a food diary where you record any changes in your eating habits.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}