{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e94f0a3c-03c1-5bf1-a2a3-5b60a311e078","task_key":"default--validation--38262","task_revision_id":"1","upstream_id":"38262","short_description":"HellaSwag validation 38262","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to achieve happiness according to the dalai lama [title] Realize that life is suffering : [substeps] To live is to suffer. The human nature is not perfect and neither is the world we live in. We have to endure suffering such as sickness, old age, and death; we have to endure psychological suffering too like sadness, fear, frustration, disappointment, and depression.\",\"endings\":\"[\\\"We're all being viewed by life as shamans, not buddhist monks. O buddha loolan is called the groom lion which is the judge of our circumstance.\\\", 'The inner spirit that is often seen is refined and unhappy. We can fit into the uniform and entrancing conditions of being where we are in this world.', 'This past is real and our outcome is personal. We might instead accept ourselves and appreciate what we have but then find out we are not doing as well as we hoped to.', 'However, there are positive experiences too that we perceive as the opposite of suffering, such as comfort and happiness. Life is imperfect and incomplete, because our world is subject to impermanence.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}