{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e9589fe9-d06c-58b9-8457-72b89191fedc","task_key":"default--validation--6492","task_revision_id":"1","upstream_id":"6492","short_description":"HellaSwag validation 6492","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to get rid of a hangover [title] Drink plenty of water. [step] The dehydration caused by alcohol consumption needs to be tackled if you are to get rid of your hangover. The most straightforward way to re-hydrate yourself is simply by drinking lots of water when you wake up.\",\"endings\":\"[\\\"[substeps] Try not to drink liquor if you're not used to it. Alcohol can dehydrate you, lower your blood pressure, and lower your electrolytes.\\\", 'This will prepare you to function at more or less normal levels and will help you to wind down faster. [substeps] Drinking from a bowl of clear or glass water rather than a plastic cup will keep you hydrated and promote high heart function.', 'Drinking bland fluids that are easy on your digestive system will help you replace lost liquid without irritating your stomach. [substeps] Drinking a pint of water before you go to bed will help to lower your dehydration levels before you wake up.', 'Most people experience dehydration at some point during the day. [substeps] Normal dehydration is usually due to swelling of the liver, which generally lasts a few days.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}