{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b7e1e38f-697b-5abe-a795-0549331fce27","task_key":"default--validation--25903","task_revision_id":"1","upstream_id":"25903","short_description":"HellaSwag validation 25903","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to do layered visual kei hair [title] If your hair is not already layered, then cut layers into your hair. [step] ( see warning! ) [title] Flat iron your hair all over (if it isn't already straight). [step] Not only does your hair need to be straight for this style, it will also make the spikes easier to pick out.\",\"endings\":\"['[title] Now when blow drying your hair, place the flat iron on the lowest heat setting, do not blow dry it, this will only make the spikes and jump out from there. [title] Add hairspray and a headband to your head.', '[title] Locate the bottom layer on your hair, and pin the other layers back. [title] Spray the separated section of your hair thoroughly with hairspray, and ruffle the hair around while you spray so it is not all sitting on top.', '[title] Heat a hair dryer to a high temperature. [step] While you can speed this up by holding it at a neutral temperature, this method works great for different hair types.', '[title] Decide where you want the spikes to be placed. [step] Head to the sink and turn on the shower faucet to a slow cycle.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}