{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8d33f22d-1fcf-5741-b776-c0426b6d7ac9","task_key":"default--validation--38521","task_revision_id":"1","upstream_id":"38521","short_description":"HellaSwag validation 38521","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to store perfume [title] Choose a spot away from direct light. [step] Sunlight can damage a perfume bottle. In general, they tend to last longer when stored in darker places.\",\"endings\":\"[\\\"Instead, opt for a dark area where the light won't shine onto you or direct sunlight, such as a gazebo or fountain. [substeps] Avoid humid areas, like basements and garages, where humidity can significantly affect your perfume.\\\", \\\"Many perfume bottles will last for many years, and will age poorly if exposed to direct sunlight. This means you can give the bottles a few months' shelf life before storage or when you'll need them on a shelf.\\\", 'When storing perfume in a dark, storage room, place it on a spot that receives indirect sunlight, so you will be able to see it before you touch it. [substeps] Any specific location in your house will work, as long as you can find it.', 'A closet or a drawer is a good way to store perfume to make it last. [substeps] Perfume that comes in a colorful bottle, rather than a clear one, may be susceptible to less damage from light.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}