{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2c5e1f37-8abb-5cdd-86d0-351f1ece36a1","task_key":"default--validation--21550","task_revision_id":"1","upstream_id":"21550","short_description":"HellaSwag validation 21550","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to fix a chipped manicure [title] Buff the surface smooth. [step] Look closely at the chip and you will see that the remaining polish is slightly raised up from the nailbed. The surface needs to be flattened before you can properly patch the chip.\",\"endings\":\"['It can be achieved with smooth polish on the nail so you can have a quick polish job done. A quick polish job usually involves rubbing your fingernail across the chipped surface, then applying gentle pressure to get the polish to realign the chip.', 'Use a fine-grit nail buffer or nail file to gently smooth out the line between your fingernail and the nail polish. [substeps] Wash your hands immediately to remove the debris left behind by filing or buffing the nail.', '[substeps] Locate a piece of scrap paper or a shirt and you should lay it flat and buffing as if you were cleaning a car is the last step before using the polish. It will probably take some time before you even get it dirty, so aim the direction of the scratch at the edge.', 'Buff the surface smooth again with a microfiber cloth. [substeps] A soft pad of cotton can also work, but be sure to store cotton cloth securely in your cosmetics bag or in the emergency kit.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}