{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"085c8e0c-b68d-59b5-b129-4afb77350396","task_key":"default--validation--38439","task_revision_id":"1","upstream_id":"38439","short_description":"HellaSwag validation 38439","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to apply a hair mask [title] Read directions carefully. [step] Many commercial hair masks come with special instructions. Some may only be designed for weekly use and some may need to be kept in for specific timeframes.\",\"endings\":\"[\\\"Since there is no time limit on how long a mask will stay in place, to ease your hair's overall resistance against dryness and frizz, read any instructions carefully. [substeps] As a last resort, the mask will not stay in for longer than a day.\\\", 'Not all hair masks can be used interchangeably in terms of the duration and frequency of use. Make sure to read instructions carefully before applying a hair mask.', 'Some masks may only be applied for up to six months and others may be used for up to a year. Some masks may only be applied for one or two weeks and others may last for longer periods.', 'If you have not learned any of these steps, read the directions and consult a hair mask specialist or chiropractor. These tips may vary from product to product and are taken on a daily basis.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}