{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5eec0cc3-bb34-53f2-84ac-5ca4656f9a7c","task_key":"default--validation--26255","task_revision_id":"1","upstream_id":"26255","short_description":"HellaSwag validation 26255","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to prevent blood clots [title] Raise your awareness with age. [step] The risk of having a first-time blood clot (vte) is 100 in 100 , 000. However, that risk goes up exponentially as we age: by age 80, the rate of vte is 500 in 100 , 000.\",\"endings\":\"[\\\"As you get older, it's important to monitor your overall health with regular medical checkups. [substeps] Recent surgery or a broken bone in your hips or legs increases your risk of blood clots.\\\", \\\"However, the decreasing rate of vte (10 %) makes the risk of advance or subsequent vte much lower. If this rate is against your physician's recommendations, be aware that you may lose some blood with this rate change.\\\", 'As you become older, you need to be significantly more conscious of your risk. This can be very helpful when you are a controlling person.', 'In places where these numbers and the number of people have advanced even further, it becomes increasingly rare that a person could have a first-time blood clot. [substeps] Any routine exposure by anyone with a history of an vte can lead to varicella and other abnormal blood clots.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}