{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"1f694a8b-3829-5fd6-8560-1202e400fd8f","task_key":"default--validation--29680","task_revision_id":"1","upstream_id":"29680","short_description":"HellaSwag validation 29680","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to have a nice hairstyle when you are obese [title] Take good care of your hair. [step] Some basic things you need are shampoo, conditioner, brush, wide toothed comb, heat protection, and whatever else you think is necessary. [substeps] It is important to keep your hair clean and conditioned.\",\"endings\":\"['Use a heat protecting shampoo once a week, but if you have very short, longer hair, use a different type. It is a good idea to use conditioner once a week for medium to long hair.', 'This does not mean scrubbing the living daylights out of your hair day in and day out, however. This simply means washing as often as needed.', 'But if your hair is oily try a leave in conditioner, cumin powder, or apple cider vinegar in shampoo. Not enough of those would work but a little spritz of cleanser can give you volume.', 'Doing that, often, will make you look like a slob. This is especially true if you are constantly changing your hair.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}