{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c1c9e822-6f03-51bc-acbb-52ffb449746f","task_key":"default--validation--31541","task_revision_id":"1","upstream_id":"31541","short_description":"HellaSwag validation 31541","config":"default","split":"validation","body":"{\"activity_label\":\"Home and Garden\",\"ctx\":\"[header] How to prevent your laundry from smelling moldy [title] Wash laundry and remove it from the sink or washing machine as soon as practicable. [step] Clean, dry laundry does not smell mouldy. Dry your laundry outside if possible.\",\"endings\":\"['If you cannot dry outside on perfect breezy, sunny day, dry inside in a well ventilated, warm room or use a tumble dryer. You can dry laundry at the laundromat too.', \\\"Submerge old clothes in cool, running water for five minutes and set your washing machine's temperature to the low setting for a nonporous substrate. [substeps] If the water from your water cycle does not drain out, place your clothes in your dryer.\\\", '[title] Rinse your laundry in hot water until the water runs clear. [title] Transfer your folded laundry to a hamper.', 'If you let your laundry dry outside, be sure to sprinkle on their oils like jojoba oil, lime oil, lavender oil, or other calming oils. [title] Use a hand dryer if your washing machine has one.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}