{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c84e650e-8f11-5351-9fa9-cabcf74b14e3","task_key":"default--validation--7457--variant-c4c6e58f763a","task_revision_id":"1","upstream_id":"7457--variant-c4c6e58f763a","short_description":"HellaSwag validation 7457","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to treat a headache with herbs [title] Determine if you have a tension headache. [step] This is the most common type of headache and it tends to be on both sides of the head, most often starting at the back of the head. The headache may \\\" move \\\" forward and affect the eyes.\",\"endings\":\"[\\\"It may also move up like a red flame or cause pain to the skin. [substeps] Tension headaches are painful and often don't easily resolve with medication.\\\", 'This is in response to low amounts of cortisol released by the brain, resulting in drowsy or heavy feelings. [substeps] When you are active, meaning you are sleeping through the night you experience tension headaches.', 'It can also have a stronger impact at the front of the head, a headache that is less commonly experienced by medical professionals. [substeps] Tension headaches usually occur primarily in the foreside of the head, which has the most usually pronounced musical, rumbling undertone.', 'The pain is most often described as dull or feeling like a tight band is around your head. [substeps] Tension headaches are often caused by tightened or strained muscles in the head and neck.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}