{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6163bef5-d51c-5d40-8c46-b937047e3e0c","task_key":"default--validation--43617","task_revision_id":"1","upstream_id":"43617","short_description":"HellaSwag validation 43617","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to cope with the loss of a loved one [title] Allow yourself to experience your feelings. [step] Losing someone you love is an emotionally devastating experience. In the aftermath of loss, you may find yourself grappling with a variety of feelings.\",\"endings\":\"[\\\"Allowing yourself to experience these emotions can help you react in a more normal way. [substeps] It's probably best to try to maintain control of your emotions and accept your emotions.\\\", \\\"It's very important that you allow yourself to feel what you are feeling, even if it's bad. Suppressing your feelings is not a good idea in the aftermath of loss.\\\", 'Remind yourself of the good times that you have shared with this person. You may spend time with them, listening to their stories, and reminisce about a good time you had apart.', 'You may take day-to-day guilt, regret, and grief over what you did to the person. You may find yourself frustrated with yourself over not surviving the loss.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}