{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c4622ac7-8428-5cf8-8ae1-e95318df8c2e","task_key":"default--validation--3210","task_revision_id":"1","upstream_id":"3210","short_description":"HellaSwag validation 3210","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to blow a fuse [title] Obtain a fuse. [step] There are two main types of fuses: cylindrical and plug fuses. Cylindrical fuses consist of a ribbon of fusible metal enclosed in a ceramic or fiber cylinder.\",\"endings\":\"['This type of fuse is usually used in appliances. Plug fuses are typically used to protect in home electrical wiring and consist of a metal strip through which current must flow.', 'They come in a variety of colors and patterns. The cylindrical cylinder is the most common type of fuse to use.', 'The cylinder is comprised of three components: a base and a cover. Plug in the plug-in fuses are one of the more expensive fuses.', 'Stem fuses consist of fercoated or otherwise coated metal that prevents air from reaching and disperses gas through its air cells. Stick fuses essentially allow gas to enter an existing coil to be expelled and dispose of as needed before firing a new coil.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}