{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"196b994c-a8f3-52f9-8522-798d1044e352","task_key":"default--validation--32604","task_revision_id":"1","upstream_id":"32604","short_description":"HellaSwag validation 32604","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to write a eulogy for a father [title] Remember it's a eulogy and not an obituary. [step] A eulogy is different from an obituary. An obituary is an overview of the facts of someone's life.\",\"endings\":\"['It lets you hear things you might otherwise never have believed. [substeps] Family heirlooms, anniversaries, and memorable events may have the experience and implications of an obituary.', 'It covers things like achievements, career, place of birth, surviving family, and so on. Eulogies focus on capturing the essence of who someone was.', 'This is important for being able to write a prompt or conclusion that supports your thoughts and your faith. [substeps] The eulogy should support your position about the means to cure the condition.', \\\"To enter this vein, the eulogy must go into the context of a family member's life. It should also include : [substeps] Parents' names race and sex grandparents' names grandchildren, divorcees, children, etc.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}