{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e4bf631f-35a9-51e8-ad84-d008eb9f5a34","task_key":"default--validation--17702","task_revision_id":"1","upstream_id":"17702","short_description":"HellaSwag validation 17702","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to feel comfortable with a scar [title] Ask yourself if you're ready to expose your scar. [step] Exposing your scars to the world is not a necessary step toward being comfortable with your scar. Some people believe that concealing the scar is an indicator of shame or discomfort.\",\"endings\":\"[\\\"If this is the case for you, you should find a safe way to accept that scar so that it goes away. It may be impossible to hide the scar fully, especially if it's new.\\\", \\\"Others believe that it's a sign of weakness or self-esteem. If you believe your scar is cause for concern, you might not want to expose it to others.\\\", 'However, this will not seem so to others, and your scar will be far from normal. Make sure that you feel ready to expose your scar, even if it hurts.', 'However, you can become comfortable with your scar without feeling obligated to expose it. Wait until you are ready to expose your scar.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}