{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9007555c-7073-5503-8143-c706be206106","task_key":"default--validation--3546","task_revision_id":"1","upstream_id":"3546","short_description":"HellaSwag validation 3546","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to epilate facial hair [title] Buy an epilator designed for the face. [step] Not all epilators are meant to be used on your face. Some are just for the body.\",\"endings\":\"['They are also available at pharmacies and medical supply stores. Look for one that breathes, fits well and is not flammable.', 'In some, however, there are special effects that occur with the procedure. These effects may include : [substeps] It can stimulate or slow down hair growth.', 'You can buy these from pet stores and/or beauty supply stores. [substeps] Buy one at the supermarket, sometimes it looks expensive.', 'Read about the epilators you are looking into to see if they are made for your face or if they have attachment heads that can be used on those areas. [substeps] Most epilators that are designed for the face are small and contain batteries.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}