{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3c89ea85-a8d5-55c3-9b6a-f23af6e440cb","task_key":"default--validation--35208","task_revision_id":"1","upstream_id":"35208","short_description":"HellaSwag validation 35208","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to help your teen explore possible careers [title] Brainstorm ideas together. [step] When your first start talking about careers, brainstorm out loud with your teen. Talk about your teen's interests in a very general sense.\",\"endings\":\"['Then, suggest activities you both might like to do in high school or college. [substeps] Some ideas could include: painting, pottery, karate, singing, dancing, writing, photography, and taking a dance class.', 'Find ideas based on what they have or may have been trained in or used to know a little about. Talking about careers will keep both of you engaged and lead to more conversation about careers.', 'From there, try to narrow things down to explore a variety of careers based around a broad interest. Together, write down a list of interests.', \\\"Always take the word for detail in your teen's vocabulary. Go for the details and don't bombard your teen with unnecessary questions or negative assumptions about certain majors and career paths.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}