{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"89048320-a4c2-575d-9799-e29654225860","task_key":"default--validation--16810","task_revision_id":"1","upstream_id":"16810","short_description":"HellaSwag validation 16810","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to improve your memory after a stroke [title] Try memory association. [step] Sometimes it's easier to remember something if you connect it to something familiar to you. This can help with certain kinds of memory loss from strokes.\",\"endings\":\"['Also, try associating the difficult or stressful memories with something interesting and significant, like listening to music or watching a movie. [substeps] What does memory association look like? It may work in different situations or times.', 'Make the association point something you already know and can easily remember. [substeps] For example, connect dates you need to remember with dates you know.', \\\"As you're improving with your memory, try associating new memories with you. Remind yourself of how you looked in the shower or how the sun was hitting your face.\\\", \\\"As you focus on the memory association and link it to your brain, you'll have a more difficult time remembering of certain situations. [substeps] For example, if your memory is of the person or thing that gives you nightmares, try to connect associations with that person.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}