{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5d51ed58-84ab-51ec-8d31-2e3e6d1534cc","task_key":"default--validation--22067","task_revision_id":"1","upstream_id":"22067","short_description":"HellaSwag validation 22067","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to teach people why it's important to avoid smoking [title] Start by mentioning that smoking doesn't only affect the lungs. [step] Every organ of the human body is affected by smoking. The lungs, heart, esophagus, larynx, liver, stomach, and pancreas are some examples.\",\"endings\":\"[\\\"Discuss any physical and emotional emotional effects of smoking with someone you know, such as : [substeps] Any relationships your workplace or home (which don't necessarily advertise smoking). Withdrawal symptoms like medical history, withdrawal symptoms, and mood swings.\\\", 'Each organ of the body responds to certain pressures, so their health is affected. Talk with your doctor about how to support the people in your life in the respect to the health of your lungs.', '[title] Let them know that smoking is the number one leading preventable cause of death in the united states. [step] It causes more deaths than hiv, illegal drug use, alcohol use, motor vehicle injuries, and firearm-related incidents combined.', 'Understanding the nuances and reasoning behind smoking can help you comprehend how to make a better-informed decision. [substeps] Just as smoking can have potential negative effects on the body, it also contributes to the metabolism of the fetus (its cells).']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}