{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"be4d0ff9-5982-5322-b020-877e691f7700","task_key":"default--validation--15519","task_revision_id":"1","upstream_id":"15519","short_description":"HellaSwag validation 15519","config":"default","split":"validation","body":"{\"activity_label\":\"Education and Communications\",\"ctx\":\"[header] How to stay calm during a test [title] Practice positive self-talk. [step] It's very easy when you're stressed to think negative thoughts about yourself. These certainly don't help ease your mind during a test, however.\",\"endings\":\"['[substeps] Practice saying a brief one-sentence affirmation such as \\\" i am able to do this. \\\" try to not only apply that line to a given situation, but try to use the entire same one in every other session.', \\\"Even if your mind is still racing with worries and feelings, you'll find yourself having positive self-talk. Not only is your self-talk good, but it can improve your mood and help you stay on track.\\\", 'Instead, make a conscious effort to think positively about your abilities and readiness for the test. [substeps] For instance, banish thoughts like \\\" there are so many questions on this test.', 'Instead, try thinking something positive at the end of the session. You can use affirmations to help you stay calm at the end.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}