{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"09cf807d-d3f9-5746-a2d9-f5e42bec2683","task_key":"default--validation--10448","task_revision_id":"1","upstream_id":"10448","short_description":"HellaSwag validation 10448","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to feel pretty [title] Understand your own prettiness. [step] This is the most important step for feeling pretty. You have to understand that your beauty comes from, not from any outside source.\",\"endings\":\"['But you have to practice feeling this way. [substeps] Write a list of all the good things about yourself.', 'It is much easier to find beauty when you believe you deserve it ,. You make the mistake of assuming that people will like your appearance, you assume that part of beauty is just your looks.', \\\"It can't be tied back to an inner drive. You have to understand your own beauty and how it works.\\\", \\\"Don't abandon your beauty, because you use it. Don't tempt yourself to go flaunt it-looking good is beauty and so is wearing it.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}