{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2e934dc0-bf78-526e-8ae8-a2b75b09085d","task_key":"default--validation--8937","task_revision_id":"1","upstream_id":"8937","short_description":"HellaSwag validation 8937","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to make a dutch braid [title] Start with neatly brushed, dry or damp hair. [step] You can do a dutch braid on dry or damp hair, but it needs to be brushed and free of any knots or tangles. If you have any flyaways, lightly mist them with water or tame them with a smoothing product like a serum or pomade.\",\"endings\":\"['[substeps] Braiding on wet hair is a great way make your hair curly without using heat. You will have to let your hair dry completely before taking the braid out, however.', 'Use a comb to brush hair down from the forehead into a low ponytail before curling or twisting it. After the ponytail is in place, use a hair straightener or smoothing serum to prevent flyaways from damaging your hair.', '[title] Take 2 or 3 sections of hair from the back of your head (near your ears) and part them. [step] Run your fingers along the section to open it up and remove any tangles.', '[title] Apply a finishing serum to your hair. [step] Many people can choose to apply a finishing serum directly to the ends of the braid.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}