{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"444f2abf-f9ab-5959-9f5f-fa4aea17d0d3","task_key":"default--validation--6821","task_revision_id":"1","upstream_id":"6821","short_description":"HellaSwag validation 6821","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to comfort someone who lost a loved one [title] Choose the appropriate time to talk. [step] In all of your interactions, make sure that bereaved person is in the proper mindset to have a discussion. They may be particularly upset or dealing with another critical issue.\",\"endings\":\"['Ask if it is a good time to talk before going on. It also usually a good idea to talk with them one-on-one, when possible.', \\\"[substeps] Always begin a conversation with someone else, only people you trust. It's important that bereaved persons find the right chance to talk to you, especially people who have the same loved one as them, so wait until the person is sleeping or is feeling better before speaking.\\\", '[substeps] Avoid scheduling a time where the bereaved person is busy or stressed. Try to prepare yourself for this discussion by taking the risk that a time that usually seems like the minimum will be enough.', 'Avoid being late because you let the person know, or like to interrupt the conversation. Make time to talk when you have both time to think about the issues surrounding the loss of a loved one and time to get some fresh perspective.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}