{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d70f001a-c5cc-55c7-9816-4d47a9a0f045","task_key":"default--validation--30665","task_revision_id":"1","upstream_id":"30665","short_description":"HellaSwag validation 30665","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to apply witch hazel to your face [title] Wash your face thoroughly. [step] Splash your face with warm water and gently rub on your favorite facial cleanser. Use cool water to rinse the cleanser off of your face.\",\"endings\":\"['Pat your skin dry using a soft, clean cloth. [substeps] Avoid scrubbing your skin or using a harsh cleanser because these can damage your skin.', \\\"Don't let the facial water sit in your face too long. This will open up the pores, make the treatment process easier on your skin.\\\", 'Make sure to scrub dry, with a soft towel. [title] Pre-exfoliate your face regularly with a coconut oil for smoothness and mobility.', 'Once you\\\\'ve washed your face, pat your face dry with a cotton towel. [substeps] Witch hazel will make your skin \\\" sickly-looking \\\" for years to come.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}