{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"255b3495-824e-5422-86cb-a186dd55c7b9","task_key":"default--validation--13490","task_revision_id":"1","upstream_id":"13490","short_description":"HellaSwag validation 13490","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to get sober [title] Drink water. [step] If you're too inebriated and you need to sober up quickly, the best way to do it is to stop drinking or using immediately, and try to get hydrated. Whatever's got your head spun, water will help to get it straighter.\",\"endings\":\"['[title] Try quick \\\" grabs \\\" starting at around 1 pm the last rest sure will be dip. [title] To add a bit more flavor to your drink : [step] Mix in a pinch of cinnamon.', \\\"[substeps] Splash some cold water on your face, as well, especially if you're on something other than booze. If you're on a downer, this can help to wake you up and sharpen your senses.\\\", '[substeps] Get in a cool and quiet place, like at a park or rest stop. Take sips of water and drink them as quickly as possible, keeping track of the order of the pitcher and the amount of fluid in the glass.', \\\"[substeps] If you're in a bar, just give up alcohol by ordering water. For a&e drinks, do the same.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}