{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ac165554-d7b7-5de8-9686-fca8328993b9","task_key":"default--validation--40498","task_revision_id":"1","upstream_id":"40498","short_description":"HellaSwag validation 40498","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to do a complete facial routine with four ingredients [title] Get a fresh, clean face. [step] You can accomplish this by using milk as a cleanser. Any grade or variety of milk is fine, though whole milk is ideal.\",\"endings\":\"['Take 1 tablespoon of milk and apply it to your face with your own hands or a cotton ball that has been dipped in it. Gently rub around your face for 2-5 minutes.', 'Shake off some of the extra milk, mix the two together with a little olive oil, and apply to your face. Allow for a minute, and rinse well with warm to lukewarm water, then pat dry with a clean cloth.', 'At this point, choose a cleanser labeled \\\" light \\\" or similar (of a higher ph). [substeps] Cold water will work, as it will just help to remove the dead skin cells.', \\\"You can also use other dairy products, such as cow's milk or skim milk. Wash your face regularly with cold water, then rinse with warm water.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}