{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7daadb86-d54a-5ff0-8185-c16b0f457b7c","task_key":"default--validation--1430","task_revision_id":"1","upstream_id":"1430","short_description":"HellaSwag validation 1430","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to make a hair clip with a scarf attached [title] Assemble the items needed. [step] These are listed below under \\\" things you'll need \\\". [substeps] For the scarf, use a smallish long sized one of a very pliable and gauze-like fabric.\",\"endings\":\"['[title] Open the barrette or hair clip. [title] Lay one end of the scarf so that it overlaps the fastener end (opening end) of the barrette or hair clip.', 'This piece needs to be about five inches and tall as to be used for braiding and using any elastic or solid size strands. For more information or instructions on using the scarf: check out: how to make a hair clip with a fabric made from cast iron, nylon, or mesh about 3 inches wide.', 'For the scarf length piece, use a small piece of thin satin tape, fabric scissors, tape or masking tape. For different wigs, different kinds of wigs are used.', 'For the long piece of cloth, use a medium sized one of a lighter color or a darker color. For the scarf: cut off a piece of the cloth that\\\\'s approximately as wide as the scarf, made to about 6 1/2 \\\" by 10 1/2 \\\".']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}