{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3ae5eb25-845b-5c51-be2b-4d74f2278c5a","task_key":"default--validation--36410","task_revision_id":"1","upstream_id":"36410","short_description":"HellaSwag validation 36410","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to protect yourself from uv radiation indoors [title] Apply a protective film to windows. [step] Ordinary glass blocks \\\" short wave \\\" uvb light, but only blocks 50% or less of the more common \\\" long wave \\\" uva light. Add a uv-protective film to any windows that are not specially built to block uv light.\",\"endings\":\"[\\\"[substeps] You can use compact plastic film for isolation, or layer bubble wrap for protection against uva radiation. By breaking down the bubble wrap, you won't risk the light harming the glass.\\\", 'You can purchase these after you go outside in the winter when the sun is out. [substeps] Just keep in mind uva radiation will unfortunately emit white light from above, so it will not be enough protection.', 'This is especially important for windows near areas where you spend a lot of time, at home, at work, or in the car. The film blocks up to 99.9% of all uv radiation.', 'Not every glass block may be covered in a uvb-protected film. For example, a window covered in a non-transparent film might still provide some uvb light.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}