{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"abe3355f-bb07-5cf6-97e0-0ac546dd158e","task_key":"default--validation--42181","task_revision_id":"1","upstream_id":"42181","short_description":"HellaSwag validation 42181","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to be adventurous [title] Let go of what is holding you back. [step] Inhibitions are feelings that make you self-conscious and unable to act in a relaxed and natural way. Perhaps you are shy, inexperienced or fearful.\",\"endings\":\"['Acting inappropriately might loosen up those around you. Try to allow yourself to bounce back from your shyness.', 'In order to let go of what is holding you back you must feel safe with yourself, your surroundings and the people around you. [substeps] Ask yourself why you want to be adventurous.', 'When confronted by a serious problem, find ways to combat it by seeking the assistance of someone who can guide you through it. This person could be a trusted friend, a family member, or a holy war instructor.', 'Letting go of these feelings sends the message to your brain that you are not a wild animal and that as a result, you are less inhibited. Remind yourself what you are more confident about: your body.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}