{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"1de64116-0e07-54cf-81a7-29971b70ab26","task_key":"default--validation--23255--variant-9f21e957582c","task_revision_id":"1","upstream_id":"23255--variant-9f21e957582c","short_description":"HellaSwag validation 23255","config":"default","split":"validation","body":"{\"activity_label\":\"Youth\",\"ctx\":\"[header] How to stop being immature [title] Practice good hygiene. [step] Present yourself to others in a mature way by appearing well groomed and well put together. This means making sure your body and face are clean, your teeth have been brushed and flossed, and you are wearing deodorant so you smell fresh.\",\"endings\":\"['Shower every day, take a shower at least twice a day, and use good smelling face wash and body wash. [substeps] If you use an already smelling bad scent, it can cause negative health issues in the rest of your body.', \\\"The way you look and act will be appreciated and you will be perceived as a mature woman. [substeps] Don't shower everyday, because in order to look like a mature woman, you need to make sure your body is clean and your teeth are maintained.\\\", 'You should always shower once a day and take time in the morning to look presentable before you step out into the world. [substeps] You should also take some time to do your hair by ensuring it is brushed and looks clean.', \\\"Aim to keep yourself looking and smelling fresh, even if you have a slight tan or a few pimples. Don't ingrain bad habits into your environment.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}