{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"48a7315d-9857-5997-8369-2ce30502ef4e","task_key":"default--validation--22812","task_revision_id":"1","upstream_id":"22812","short_description":"HellaSwag validation 22812","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to convince your spouse to follow your expectations [title] Lead by example. [step] Your partner will observe your habits and behaviors and begin to imitate them. If you ignore your spouse and let your temper fly off the hook, your spouse will react poorly to you.\",\"endings\":\"['[substeps] When you initiate an activity, commit to it. If you think that you are communicating accurately, your spouse will be far more likely to follow through if they feel as though the task is absolute necessity.', 'He or she will make disrespectful statements, say things like, \\\" that\\\\'s my concern. We discuss it later, \\\" and won\\\\'t bother to give you a chance to correct the behavior.', 'If you show respect and affection, your partner will return the same to you. Make decisions that are in the best interest of both.', \\\"You'll know when your partner sees you can be a little controlling and assertive. [substeps] If you want your partner to follow what you tell them, you want to discourage your partner from doing so.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}