{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8588864b-ac68-5bf3-9690-5c35936d0566","task_key":"default--validation--18795","task_revision_id":"1","upstream_id":"18795","short_description":"HellaSwag validation 18795","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to make your hair healthy again [title] Handle your hair gently. [step] Damaged hair is very brittle, and it needs to be handled with care. If you're rough with your hair it can split or break, and it will look more frizzy than ever.\",\"endings\":\"['If you run your hand through your hair a lot, it may come out with split ends. After a week of brushing and \\\" plucking \\\" you might also want to start shaving off split ends.', 'To correct this, comb your hair slowly through or re-style it as needed, preferably with a diffuser or flat-top. [title] Wash your hair using warm, low-to medium and low-flow (tcas) water and rinse it well.', \\\"If you're gentle and controlled in this process, you'll be able to restore your hair's shape to it's normal state. [substeps] To treat split roots, use a comb to gently detangle any hair above the roots so that it is reworked.\\\", \\\"Starting today, handle your hair with extra care, whether it's wet or dry. Here's what to do : [substeps] When you're applying shampoo and other products, use your fingers to gently pull the product through your hair from roots to tips.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}