{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"43711a30-90c7-56ba-ab4e-d65731e560e7","task_key":"default--validation--44435--variant-42a0dec42e3d","task_revision_id":"1","upstream_id":"44435--variant-42a0dec42e3d","short_description":"HellaSwag validation 44435","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to stop coughing at night [title] Sleep on an incline. [step] Prop yourself on pillows before you go to sleep and try to sleep on more than one pillow. This will prevent all the postnasal drainage and mucus you swallow during the day from backing up in your throat when you lay down at night.\",\"endings\":\"['[substeps] If possible, sleep on a bed with a floor cover or a sheet instead of a regular mattress. For stubborn postnasal drainage, try draping a coat over the bed because that will offer more comfort.', '[substeps] This will keep you from turning into a torpid zombie in the middle of the night. Your face should also be immobilized, especially around the eyes and mouth.', '[title] Avoid the temptation to sneeze or cough during the day. [step] If you have postnasal alkalosis, take frequent breaks every hour to wipe mucus from your throat.', \\\"[substeps] You can also place wooden blocks under the head of your bed to raise it by 4 inches. This angle will help to keep acids down in your stomach so they won't irritate your throat.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}