{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"921a008c-575d-5af1-a28d-c08d4016ac89","task_key":"default--validation--11589","task_revision_id":"1","upstream_id":"11589","short_description":"HellaSwag validation 11589","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to handle sexual harassment from a clergy member [title] Talk to a trusted individual. [step] Set clear boundaries with the perpetrator and keep them. Setting boundaries should include communicating what the boundaries are in your interactions together.\",\"endings\":\"['[substeps] If this is your first encounter with the perpetrator you should be very cordial with them as much as possible. Keep dialogue brief and no more than five to ten minutes.', 'Set rules for what individual members can or cannot keep from the conversation. [substeps] Keep the boundary open and attainable for either team to establish trust as a group.', '[substeps] Avoid breaking the laws in the united states. If a person is engaging in sexual harassment or harassing you, contact an equal employment opportunity bureau (aap).', 'It may also be important to indicate what will happen if the clergy member does not respect the boundaries. Communicate these boundaries to the perpetrator in whatever way makes you comfortable (in person with a trusted person with you, over email, text, etc.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}