{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"633a4a2a-7a7e-50ed-aaf8-b024b288e6a9","task_key":"default--validation--16465","task_revision_id":"1","upstream_id":"16465","short_description":"HellaSwag validation 16465","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to get a proper tan [title] Increase your sun exposure gradually. [step] First and foremost, when you begin laying out in the sun, only get 1-2 hours of exposure at a time. Skip a day or two before laying out again.\",\"endings\":\"['Melanin, the pigment in your body that colors your skin, is activated when uva and uvb rays from the sun hit your skin. When this happens, more melanin is produced as a form of sun block, or protection from sun damage.', '[title] Make sure your workspace is in good condition. [step] It is not good for you to be in a tanning bed with no air conditioning, and even worse, in a tanning pool filled with fake-tan chairs made out of commercial materials.', \\\"Once you're ready, you can begin it all! [substeps] Apply a sunscreen when you're sunbathing. Do not apply sunscreen to your face at night or in the shower.\\\", 'Keep your eyes on your sunscreen as you leave to reapply it. While natural sunscreens may turn out great and fashionable at the same time, they also reduce the amount of melanin in your body, making you less likely to get sunburned.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}