{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ea70d26f-5967-58c3-8607-5107d04f4dcd","task_key":"default--validation--21851--variant-d3dff587c0e1","task_revision_id":"1","upstream_id":"21851--variant-d3dff587c0e1","short_description":"HellaSwag validation 21851","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to braid [title] Brush your hair. [step] Brush your hair so it is light and fluffy. You want to get rid of any knots so your braid is silky smooth! This also makes the braiding process easier, so make sure you do it.\",\"endings\":\"['[title] Take three to four inches (5 to 10 cm) of hair from the back of your head, comb it out, and place it in a braid holder. [step] Tie it up, and put it back in the holder.', 'If your hair is very tangled it may all drip down and you may not be able to braid it as neatly! [title] Wrap your hair. [step] With your hair in rollers, curl it around your finger so all the rollers are tucked into.', '[title] Decide where the braid is going to be. [step] Is it going to be at the back of your head on a pony tail? Is it going to be at the side or lower down near your neck? Decide this to determine where and how it will look best.', \\\"[title] Wet your hair and fluff it up gently with your fingers so you have a nice, fluffy result. [step] It's probably easy to part with a little pull, but be careful not to.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}