{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"07a1ec58-d272-56a3-bd58-b2333f432755","task_key":"default--validation--36158","task_revision_id":"1","upstream_id":"36158","short_description":"HellaSwag validation 36158","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to get shiny hair [title] Use an egg. [step] It may sound strange, but an egg can do wonders for your hair. The yolk nourishes your hair by adding moisture so that it doesn't look dull.\",\"endings\":\"['Some people find that egg cures their hair faster than egg yolks. [substeps] Egg yolks contain vitamins a, e.', 'Just like eggs, eggs also seal up your hair, allowing you to have the best hair possible. It also helps to keep your hair dry so that it is already shiny.', 'Just about any egg will do, as long as you keep your hair healthy and soft to start with. [title] Use bed noodles (or oatmeal).', 'The white clarifies your hair by helping to remove any buildup. The egg also has protein in it, which strengthens your hair.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}