{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e6e5bb0d-cb17-5ff8-a164-f0372d02c15b","task_key":"default--validation--4205","task_revision_id":"1","upstream_id":"4205","short_description":"HellaSwag validation 4205","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to create a different personality [title] Define personality. [step] Prior to identifying your own personality or the personalities of others, you must understand its foundational meaning. Personality is a set of traits, which include a person's mood, emotions, and behaviors.\",\"endings\":\"['These traits should be pretty stable and consistent prior to labeling yourself or someone else with a particular personality. Your personality can affect both your mood and emotional responses.', 'If you have a personality you do not want people to label you or change you into, describe it. This outline sets out its strengths and weaknesses.', \\\"It's important that you focus on these characteristics throughout your life. Make sure that what you do know about your personality makes you unique.\\\", 'This is vital to creating a different personality. [substeps] Personality traits are complex and can vary dramatically.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}