{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0a5d8e3a-3ec4-5c07-ac12-efe609e29103","task_key":"default--validation--39595","task_revision_id":"1","upstream_id":"39595","short_description":"HellaSwag validation 39595","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to show commitment when you don't want a wedding ring [title] Be resolute in your decision. [step] While rings are symbolic as a sign of unity, they are also bedecked in traditions that may or may not be applicable to you. Not everyone appreciates the symbolism of rings, nor even using symbolism as part of their wedding ceremony.\",\"endings\":\"['The symbolic relationship between proposing in your wedding, and setting up a ceremony in front of a large group, is crucial if you want to try it. [substeps] Explain to your partner and your fellow couple why wearing a wedding ring is important to get engaged.', \\\"As a result, know that following a graduation ceremony, for example, indicates commitment. [substeps] That's where friends and family are coming from.\\\", \\\"If you are not a traditionalist, if you have thought carefully about the purpose and intent behind your marriage, rings may not not feature highly as an outward display of your commitment. Bear in mind : [substeps] Rings don't make the commitment, you do.\\\", 'A major factor while choosing a ring for engagement is your commitment to other people. This may sound like a minor concern, but it is important to convince both people that the crown you wear is significant and special to you.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}