{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3df83b64-4b0a-5ac9-86e8-c64223027399","task_key":"default--validation--35798","task_revision_id":"1","upstream_id":"35798","short_description":"HellaSwag validation 35798","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to sleep with broken ribs [title] Pick the most comfortable position for you. [step] You may find that sleeping on your back is the most comfortable position when you have broken ribs, or you may find it more comfortable to sleep on your side. Both of these sleep positions are okay to use when you have broken ribs.\",\"endings\":\"[\\\"If you wake up in the middle of the night and can't sleep on your side, pick a comfortable position to sleep on. [substeps] You can also avoid sleeping on your stomach if you have broken ribs, since the resting position will help you get closer to your ribs.\\\", \\\"[substeps] In general, you should sleep on your side. This won't enable any jerky movements.\\\", 'Sleeping on your side or on your back will also help to make breathing easier. Try out different positions to find the most comfortable position for you.', '[substeps] You may feel more secure if you are laying on your back. You can support your weight by wrapping a string or several sling loops around the sleeping surface.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}