{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4a18b11c-ead9-509c-a6f8-464283ae4a75","task_key":"default--validation--20272","task_revision_id":"1","upstream_id":"20272","short_description":"HellaSwag validation 20272","config":"default","split":"validation","body":"{\"activity_label\":\"Relationships\",\"ctx\":\"[header] How to tell if your ex still cares [title] Watch for friendly and consistent communication. [step] After a breakup, friendly communication means that your relationship is still positive. This means that there is a chance that they still hold a flame for you and want to remain involved in your life.\",\"endings\":\"[\\\"However, they also may open up a little more if they're even beginning to see you or in another relationship. Many times a period of positive communication occurs immediately upon a breakup.\\\", 'This can be more or less than friendly. [substeps] As you get to know your ex, you may notice that they occasionally ask for your contact information or that they text regularly.', 'You may find that they still react to any emotional texts and phone calls that you have sent them. [substeps] This may be a sign that your ex still shares a lot about you, or that they are struggling to maintain contact.', 'Some signs of their possible interest are : [substeps] Frequent \\\" hello\\\\'s \\\" and \\\" hi\\\\'s \\\" even if you\\\\'ve already seen them once that day. These little greetings can mean that they still want to talk to you, but are too nervous and unsure to take further steps.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}