{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8a065c76-ced8-5cd9-a983-c304edf2e36e","task_key":"default--validation--41583","task_revision_id":"1","upstream_id":"41583","short_description":"HellaSwag validation 41583","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to mediate family arguments [title] Think about everyone's perspective. [step] Before attempting to mediate disagreements, make sure you look at all sides of the argument. While you shouldn't take sides when attempting to mediate, you don't want anyone to think you're overlooking their point of view.\",\"endings\":\"['Remember, however, that you have three options : [substeps] Persuade, not reason or move-on. Offer a solution that everyone agrees on and walk away.', 'If you point out that your family member has a point, you can subtly nudge them towards a different viewpoint. [substeps] Try a self-deprecating comment like, \\\" thank you, but i disagree.', 'If each side of the argument challenges the other, then you and the other person come into conflict as a team. [title] Decide who is right and who is wrong.', 'Take some time to think about why everyone feels wronged or hurt in the situation. [substeps] You will have to resist the urge to judge here.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}