{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f91ece4f-5ff0-5bfe-83d2-2e93238359f6","task_key":"default--validation--6761","task_revision_id":"1","upstream_id":"6761","short_description":"HellaSwag validation 6761","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to remove oil from your face [title] Use blotting paper. [step] Blotting paper is smooth, absorbent paper that removes oil without taking off your makeup. It's the most convenient quick fix for an oily face: simple take out a sheet and blot your forehead, nose, chin, and any other oily spots.\",\"endings\":\"['You can also put some magic flour onto a cotton ball, and wipe it around your forehead and nose. [substeps] With a little bit of persistence, you should still have to wipe away some oil from your forehead.', \\\"Rinse the paper off with water and blot the oily areas with a dish cloth, paper towel, or cloth. Then, you're ready to go.\\\", \\\"Don't rub your head or face with this. Make sure to blot in the right direction! [title] Obtain a cloth.\\\", \\\"You can buy blotting paper at most drugstores, but if you don't have it on hand, try one of these handy substitutes : [substeps] Tissue paper. Use the plain white kind that that you use to wrap presents.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}