{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ea28ad5c-8eea-51a2-a775-a16cb6cd0c15","task_key":"default--validation--20471","task_revision_id":"1","upstream_id":"20471","short_description":"HellaSwag validation 20471","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to have a good family life [title] Respect what your family members have to say. [step] When someone expresses an opinion, don't dismiss it or interrupt them before they can finish speaking. Maintaining open, respectful communication channels will help your family develop trust and strengthen your bond.\",\"endings\":\"[\\\"If you feel confrontational or your family member dislikes something, don't hit them back or say something you won't regret later in the relationship. Instead, listen and make an effort to understand what that person wants.\\\", '[substeps] Working together is essential to demonstrate to your family that you respect their opinions. [title] Avoid spreading private information to friends and family.', '[substeps] For instance, avoid making fun of your siblings whenever they express an opinion. If your siblings pick on you, try telling them, \\\" i know that all brothers and sisters mess with each other, but it hurts my feelings when you make fun of everything i say.', '[substeps] Only listen to your family members if they are completely honest. For example, you could say, \\\" kevin, i respect your opinion, but i don\\\\'t agree.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}