{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a598d79f-15f9-540e-b37b-c74e144d42df","task_key":"default--validation--40895","task_revision_id":"1","upstream_id":"40895","short_description":"HellaSwag validation 40895","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to balance work and family [title] Decide what your values are for yourself and your family. [step] A value is a principle, standard, or quality considered worthwhile or desired. Values guide our actions and structure our lives.\",\"endings\":\"['Make a list of values you feel have value to you. [substeps] Look at how often you feel valued or desired.', \\\"Decide what your values are and draw inspiration to your personal goals : [substeps] Don't immediately become addicted to a book or tv series immediately. Don't give up faith in nature, visual or scientific intent of mind, decade-long solitary time despite out growing money.\\\", '[substeps] Areas where we often have strong values include housework, meal times, child care, car and house maintenance, relationships between spouses and parents and children, education, money, politics, religion, etc. Specifying your values is key to managing work and family demands.', 'Grandparents are often taught a value is something that each parent doesn\\\\'t think otherwise, like \\\" because we are doing the best job. \\\" in turns, values dictate what we do and the way we live.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}