{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f8d8c0fa-26e0-5b3c-b4d9-786a0eda3a90","task_key":"default--validation--23307","task_revision_id":"1","upstream_id":"23307","short_description":"HellaSwag validation 23307","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to get big wavy hair [title] Wash and condition your hair. [step] In order to achieve maximum volume, you'll want your hair to be as clean and un-oily as possible, so be sure to shampoo it well. [substeps] In addition to shampooing your hair really well, only use conditioner on your ends.\",\"endings\":\"['Putting it anywhere else will weigh down your hair, making it more difficult to add volume to it later. If you have colored or otherwise damaged hair, avoid volumizing shampoos and conditioners as these can cause dryness and further damage.', 'Some shampoos that are anti-dandruff-killing include dove-helix shampoo and clarifying shampoo. [title] Apply a deep conditioner or leave-in conditioner.', 'Using conditioner can result in flyaways, split ends, and frizz. [title] Use a lemon-scented moisturizer.', 'Add in all natural ingredients when rinsing. Avoid products with undertones such as coconut oil, agave, and almond oil.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}