{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4283a2d4-0ea6-5359-9062-653f9214b8e9","task_key":"default--validation--31201","task_revision_id":"1","upstream_id":"31201","short_description":"HellaSwag validation 31201","config":"default","split":"validation","body":"{\"activity_label\":\"Computers and Electronics\",\"ctx\":\"[header] How to make your hair look short [title] Put your hair up in a ponytail or bun. [step] Let the shorter layers of your hair hang loose, creating a \\\" short \\\" look, while the bulk of your longer hair is pulled back and out of the way. From the front, it will look like you have a shorter cut.\",\"endings\":\"[\\\"[substeps] Put each side of your hair in the ponytail so it comes loose and flows down to the sides of your head. Create a small clip so your hair isn't looking as sloppy.\\\", 'The ponytail can either be left as it is or rolled up and pinned against the back of your head. [substeps] Putting your hair in a bun is also a great way to disguise length.', '[substeps] By securing your hair in a ponytail or bun, you are also distributing the weight evenly throughout the short hair. This will look more natural by simply making sure that the split ends are the same length as one another.', 'Position your hands above your head to form a sort of \\\" sock lice \\\"-style braid. Using your index fingers, split each hair into four sides.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}