{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"1fd20d66-d490-5af7-957a-f68f05a318c8","task_key":"default--validation--39546","task_revision_id":"1","upstream_id":"39546","short_description":"HellaSwag validation 39546","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to help your loved one get well [title] Make sure to take good care of yourself. [step] Frequently care givers overlook their own health and well-being while taking care of others. This is a very difficult and stressful time for everyone involved.\",\"endings\":\"['[substeps] Taking care of yourself is not only about taking care of the self, but about making sure that you are eating properly, being physically and mentally fit, and providing good nutritious foods. And whenever you think of serving yourself and your loved one an unhealthy diet, for example, take the time to go see a nutritionist.', \\\"If you're not well rested, not getting your sleep, it is virtually impossible for you to be able to provide the assistance and support your loved one needs. Sometimes this requires difficult choices, but the bottom line remains.\\\", \\\"It's a good idea to make sure to take extra care of your physical and emotional health. You can do these things at home or by yourself.\\\", 'Be kind to yourself and make an effort to manage your stress. [substeps] Shower every day and bathe twice a day.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}