{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"50978662-b797-5b6a-ac82-1b08b9efda8b","task_key":"default--validation--38558","task_revision_id":"1","upstream_id":"38558","short_description":"HellaSwag validation 38558","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to bloom where you're planted [title] Acknowledge that you can control your thoughts. [step] Many people feel that their thoughts are beyond their control. While we're never in complete control of our feelings and emotions, there are things we can do to direct our thoughts.\",\"endings\":\"['While you cannot always change your circumstances, you can work on adjusting your own perspective. [substeps] Remember, you can control your attitude.', \\\"If you struggle with negative thoughts or reflections, it's because your mind is not functioning well. Once you start noticing negative thoughts and reflections, stop thinking and find ways to get them out of your head.\\\", 'Think about what might happen in the future as a result of a thought or action. It may help you move the thought away from your head.', \\\"One of the core fears of botanical gardeners are having unrealistic expectations about the plants they're developing. Being able to cope with this level of unrealistic expectations can help you understand that there are others out there for you.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}