{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"fa6d1377-aea2-5851-87ac-c89d39074aaf","task_key":"default--validation--9176","task_revision_id":"1","upstream_id":"9176","short_description":"HellaSwag validation 9176","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to follow a healthy diet for multiple sclerosis [title] Include fiber in your diet. [step] Constipation is common for people diagnosed with ms and as a result fiber is recommended. Fiber is relatively easy for your body to digest and helps the digestive tract function properly.\",\"endings\":\"['Most people with ms maintain a balanced and diverse diet for about 2-3 years. You should eat as much as a fruit, vegetables, whole grains, and lean meat and not a lot of fats.', 'Try to drink one cup of water a day (have one water bottle with you? ) to get a daily fiber boost. [substeps] Consume high nutrient rich foods like vegetables and fruit.', 'Foods that are high in fiber such as fruits and vegetables, whole grains, and lentils can help to ease bowel troubles. For example, raspberries, apples and pears (with skin) are an excellent source of fiber.', 'It also helps dilute folate, which causes swelling of the liver. Most members of the healthcare team recommend incorporate whole grain bread, cereal, oatmeal, and plain white bread into your diets.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}