{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f7641279-24dd-50f0-ab18-4eab2a0fe3a1","task_key":"default--validation--29994","task_revision_id":"1","upstream_id":"29994","short_description":"HellaSwag validation 29994","config":"default","split":"validation","body":"{\"activity_label\":\"Youth\",\"ctx\":\"[header] How to be close to your crush [title] Find common interests. [step] One of the simplest ways to be closer is to find activities and interests that you and your crush both like. Talk with your crush about something they like.\",\"endings\":\"['Alternatively, read a book you both like. If you both prefer at least some of the same books, try out reading together.', 'Identify the interests that match your own, and spend more time on those activities. [substeps] Consider asking things like, \\\" what\\\\'s it like being on the soccer team? I used to play soccer \\\" or, \\\" i noticed that you like to draw.', \\\"You can do this together, or simply sit next to one another and reminisce about the topics you both like. Doing this can make the connection between the two of you more apparent, as you'll have the chance to show your crush that you really do like them too.\\\", 'Maybe your favorite movie, maybe your best friend likes chess or if one of you likes a book you think they might enjoy, keep that interest in mind. Find things you enjoy in that interest too.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}