{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"bab3dfbc-1db2-576b-bd8b-a4c63a6078d1","task_key":"default--validation--31997","task_revision_id":"1","upstream_id":"31997","short_description":"HellaSwag validation 31997","config":"default","split":"validation","body":"{\"activity_label\":\"Youth\",\"ctx\":\"[header] How to leave friends when moving (teenagers ) [title] Journal out your thoughts. [step] Journaling is a great tool if you want to work through the emotions that you're experiencing. Get out some paper and a pencil and write out your thoughts, however they come to you.\",\"endings\":\"[\\\"This will make writing them easier to remember and freer you to think clearly about what's going on in your head. You will definitely remember how this experience made you feel.\\\", \\\"Try writing everything down, from your name to your cat's name to the name of a fictional character. Whatever's on your mind is apt to come to you.\\\", \\\"You can even imagine them as a pin on your bun or the first page of your text text mail. [substeps] Write down what you're feeling and who exactly you're writing it to.\\\", '[substeps] You might express yourself best through poetry or songwriting. You can also try writing out a list of all the worries you have about this new move and what you can do about those worries.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}