{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6d3aab99-34c8-562a-a3fe-8751cd93f246","task_key":"default--validation--12102","task_revision_id":"1","upstream_id":"12102","short_description":"HellaSwag validation 12102","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to cope with a condescending spouse [title] Determine the best time to approach your spouse. [step] During the heat of the moment may not be the best time to have the conversation, since tempers are charged and either of you might say something regrettable. [substeps] Meet soon after the condescending action occurs.\",\"endings\":\"['If you allow too much time to pass, the incident will be forgotten and the details will become blurry. Try to sit down with your spouse within a few days of the incident in order to address it while it is still fresh.', 'Try to schedule this conversation about an hour after the argument happened to limit it from precipitating a productive dialogue. Do not call your spouse before they stop talking and use the focus solely on yourself.', \\\"Wait to discuss the situation in a social setting, like at work or at school, since both of you may not be able to meet once you've cooled down. Do not, however, call your spouse when they are likely to be around other people.\\\", 'Give your spouse a day or two to cool down before you approach him again. Do not tackle the issue together until after he has had time to calm down.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}