{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"1261ec08-028b-5be3-b0dc-6ecdadf523d7","task_key":"default--validation--22221","task_revision_id":"1","upstream_id":"22221","short_description":"HellaSwag validation 22221","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to get rid of a hangover [title] Drink plenty of water. [step] The dehydration caused by alcohol consumption needs to be tackled if you are to get rid of your hangover. The most straightforward way to re-hydrate yourself is simply by drinking lots of water when you wake up.\",\"endings\":\"['Drinking bland fluids that are easy on your digestive system will help you replace lost liquid without irritating your stomach. [substeps] Drinking a pint of water before you go to bed will help to lower your dehydration levels before you wake up.', \\\"Make sure you're drinking plenty of water to ensure that you aren't dehydrated. You may want to consider getting a full glass of water every day so that you have enough to drink.\\\", \\\"If you drink enough water, this will help flush the liquor out of your system. [substeps] The amount of water shouldn't be constant.\\\", \\\"Although it's hard to magically throw away alcohol, drinking enough water will make it easier for you to get it out of your system. [substeps] Water is a natural drink and it keeps you hydrated and from dehydrating your body.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}