{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"81d49ed9-e1cc-5223-b6cd-9f58683a5cba","task_key":"default--validation--36148","task_revision_id":"1","upstream_id":"36148","short_description":"HellaSwag validation 36148","config":"default","split":"validation","body":"{\"activity_label\":\"Computers and Electronics\",\"ctx\":\"[header] How to support a loved one who has been laid off [title] Realize that the conversation will be uncomfortable. [step] There isn't any way to avoid the conversation being a little bit uncomfortable. What is most important is that you have the conversation with your loved one.\",\"endings\":\"['Keep in mind that your loved one is affected more substantially by being the person who was laid off, and thus is more sensitive to the topic. [substeps] Even if it is your spouse that was laid off and the financial burden now falls on you, keep in mind that your spouse already knows that.', 'It can be easy to hurt your loved one if they are not being totally truthful about what they did. Try to be the bigger person and remember that what they said in conversation was merely an opinion.', 'You may feel angry, sad, or even upset. Think of ways to ease these feelings into any conversation : [substeps] Verbally acknowledge that you are feeling the feelings.', 'Remember that you are the one making a decision. In fact, you are actually obligated to make the decision.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}