{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"cb155d2d-2bf6-5f44-8641-551bf6773c5a","task_key":"default--validation--20486","task_revision_id":"1","upstream_id":"20486","short_description":"HellaSwag validation 20486","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to clean heat styling tools [title] Clean your hair straightener. [step] If you straighten your hair regularly, you should clean your hair straightener on occasion to stop dirt and debris from dirtying your hair. First, unplug your hair straightener and let it cool until you can easily touch it.\",\"endings\":\"['Then, twist your hair around the outer shaft of the straightener and gently push down. Then, begin moving it gently from the center of your head to the crown and back.', \\\"[substeps] You'll want to clean it every few days. After waking up and changing into clothes, it can be easy to make a habit of brushing it for a longer period.\\\", 'Then, thoroughly wash your hair with shampoo in your normal amount. [substeps] If you have sensitive hair, dry your hair with a towel before you use the straightener.', '[substeps] Place some rubbing oil on a paper towel and gently wipe down the hair straightener. If you notice any stuck on debris, scrub this off with a toothbrush.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}