{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e7affcb5-88aa-5f1b-b467-e31a898e7af2","task_key":"default--validation--28560","task_revision_id":"1","upstream_id":"28560","short_description":"HellaSwag validation 28560","config":"default","split":"validation","body":"{\"activity_label\":\"Sports and Fitness\",\"ctx\":\"[header] How to fiberglass speaker boxes [title] Clean your work area thoroughly. [step] It is highly undesirable to allow dust to collect on the fiberglass resin. If you're working in the trunk or any part of the car that has carpeting, it advisable to remove it.\",\"endings\":\"['[title] Lay plastic covering around the area where you want the speaker enclosure. [step] Cover any surface where you do not want resin dust.', '[substeps] Remove scuff marks, dents, or other damages. Place pieces of fiberglass resin on boards, clamp, and other hard surfaces.', 'Clean it with a sponge or cloth first so all traces of dirt is removed. [substeps] When cleaning your speakers, follow these recommendations: do not touch your speakers, as this can cause serious damage.', 'Remove all dust from floor boards, carpet, chairs, and areas where the panel is installed. [substeps] If there are any air vents or ventilation holes on the inside of the speaker box, replace those or open them so a draft can circulate.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}