{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"264d2b3f-f500-5e0e-8a67-a048ada17318","task_key":"default--validation--35095--variant-9af4e7e14de7","task_revision_id":"1","upstream_id":"35095--variant-9af4e7e14de7","short_description":"HellaSwag validation 35095","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to grow long, strong nails [title] Stop biting your nails. [step] Biting your nails is detrimental to your health. Although a regular nervous habit for many, it can cause bacterial skin infections on your hands and in your mouth.\",\"endings\":\"[\\\"If you have dry or loose skin around your nail beds, make sure to clip them away rather than biting them off. [substeps] Try keeping your nails neatly polished or add nail art, so you'll be less apt to biting.\\\", '[substeps] Make sure to chew your nails for at least 15 seconds before biting. This will help the disease spread to your teeth rather than just your nails.', '[substeps] Your immune system is in decline as well. When bitten, your nails can start to break down and become brittle, which causes additional skin damage.', 'Either stop biting your nails (and the skin around them), or stop biting them entirely when you feel irritated. [substeps] There is debate on whether or not biting your nails can prevent and stop infections from developing.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}