{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2da0fe0a-2713-5849-a59a-54ed508eee38","task_key":"default--validation--2965","task_revision_id":"1","upstream_id":"2965","short_description":"HellaSwag validation 2965","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to find your sleep number [title] Lie down on your sleep number bed in your favorite, most comfortable sleeping position. [step] Your favorite sleeping position is often the same position you wake up in. [title] Adjust your pillow to your liking, and mimic how you normally like to fall asleep.\",\"endings\":\"['[step] This might be resting on your back, on your side, or even in your more bed-like/closer to the headboard. [title] Go straight to sleep! [step] It is not the same as sleeping on your back, but that just adds comfortability to your bed.', '[title] If you have any pillow attachments on your bed for deep sleeps, experiment with adding more pillows, ones that will help you sleep longer. [step] Find the rolling toward comfortable position where your feet and head are in alignment as you sleep--as if you were sleeping a pet.', '[title] Press the \\\" l \\\" or \\\" r \\\" button on the sleep number remote to select your side of the bed. [step] For example, if you sleep on the right side of the bed, press the \\\" r \\\" button.', \\\"[step] Now that you've started sleeping there, a fixed position (with your eyes closed) is effectively more comfortable than if you were to sleep on your side. [title] Relax your muscles before you go to sleep by relaxing them with deep breathing.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}