{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9fb84223-a4b5-5a93-a339-77fe78390553","task_key":"default--validation--24528","task_revision_id":"1","upstream_id":"24528","short_description":"HellaSwag validation 24528","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to look fresh [title] Get enough sleep. [step] Sleep is arguably the most important part of looking fresh. After all, when people are thinking about freshness, the first thing they think of is probably someone who is at the start of their day following a long and fruitful rest.\",\"endings\":\"['People who sleep at least 8 hours per night actually feel more attractive, and they tend to look it too. Prolonged sleep deprivation comes with a laundry list of negative traits, not least of which includes dark eye circles and a bloodshot complexion.', 'Make sure your body is also communicating with your brain, and it will be quite easy to detect any changes in your mood from lack of sleep. For instance, sleeping is an important part of any well-balanced mind.', 'So being well rested and fresh is important. [substeps] Sleep emphasizes your--and the gums.', \\\"Don't catch your blood pressure rising before you get to work or be late to school just to view fresh skin. Think carefully about your lifestyle and why you like it, as well as your body type.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}