{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7c7f4b3f-2a2b-5ad9-bfbb-e2c35f3fdb67","task_key":"default--validation--22874","task_revision_id":"1","upstream_id":"22874","short_description":"HellaSwag validation 22874","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to apply latex makeup [title] Shave the area before applying liquid latex. [step] As it dries, liquid latex will get caught in any hair underneath the application area, which will cause pain when you attempt to remove the latex. If possible, shave the area so you have a pain-free removal process once the latex has dried.\",\"endings\":\"[\\\"[title] Coat any hair you don't shave with vegetable oil or petroleum jelly. [step] If you're applying latex onto an area you can't shave, like your eyebrows, try coating them with a moderate, even layer of vegetable oil or petroleum jelly.\\\", '[substeps] Make sure that, on your thighs and behind your knees, you wash your hands prior to applying liquid latex makeup. You can also use an alcohol-based latex soap (baby-safe instead ,).', '[title] Apply latex over the existing layer of skin. [step] Fill a q-tip with latex and apply it over the removing layer of skin that you are going to apply liquid latex to.', \\\"[substeps] Avoid shaving the area with hairs, as they're more likely to get caught underneath the surface. You can also wash your hands after applying liquid latex to prevent further irritation.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}