{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6d193a35-7bd0-5442-8ae3-e659d97c67c0","task_key":"default--validation--23543","task_revision_id":"1","upstream_id":"23543","short_description":"HellaSwag validation 23543","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to have shiny skin [title] Wash your face twice a day. [step] Your skin could be dull because it's covered in dead skin, and it may have accumulated dirt and oil over the course of the day or night. Washing will clear your pores and remove excess oil and dirt.\",\"endings\":\"[\\\"[substeps] When a brush, electric rinse, or face wash isn't as effective as a regular brush, take a moment to look for results. In the end, you should pay attention to blemishes.\\\", \\\"[substeps] After you wash your face, let it air dry. If you've already showered, changing your clothes before going to bed is a great idea as they're less likely to dry.\\\", 'Using good-quality shampoo will ensure that your face stays clean and flawless all day. [title] Add lip stain or body lotion.', 'Do not wash your face more than twice a day, however. You may irritate and dry out your skin, which will lead to a dull appearance.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}