{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0bbafac6-7295-5bc2-867b-31a46a7611c7","task_key":"default--validation--24774","task_revision_id":"1","upstream_id":"24774","short_description":"HellaSwag validation 24774","config":"default","split":"validation","body":"{\"activity_label\":\"Youth\",\"ctx\":\"[header] How to get over a crush because you have moved away [title] Decide whether or not you want to stay in touch. [step] For some people, staying in touch can be a nice way to keep a friend who you've got a little crush on. For others, it can be like torture.\",\"endings\":\"[\\\"[substeps] Know what it's like to be apart. Your feelings are the proof that you care and that the relationship is worth pursuing and that a friendship is worth keeping, not just a platonic friendship.\\\", \\\"If you decide that the two of you want to end things, your friend should probably go back to someone else. [substeps] You can always be pals when you're apart.\\\", \\\"Decide if you're likely to ever see this person in real life again, or if staying in touch will only make it worse. [substeps] If you can't be together and don't live in the same area, consider cutting all ties.\\\", \\\"Deciding whether or not you want to stay in touch can cause hurt for both you and your friend. [substeps] If you haven't been able to call or text each other in a while, it can be because you didn't actually get together.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}