{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9b51ca03-2041-5300-b69f-7ff27199b94a","task_key":"default--validation--10254","task_revision_id":"1","upstream_id":"10254","short_description":"HellaSwag validation 10254","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to ask god for forgiveness [title] Name and admit the thing you've done. [step] Before asking forgiveness, you must specifically state the thing you did wrong and admit that you did it. If you're feeling guilty, you may be tempted to make excuses or deny that you did anything wrong.\",\"endings\":\"[\\\"However, once you're able to admit the thing you didn't wrong, you can acknowledge exactly what you did and why the person wronged you. In real life, you are responsible for making sure the person you're asking forgiveness doesn't get very angry and lose faith in you.\\\", \\\"However, you have the right to name the thing you couldn't make but admitted and admit it afterwards. If you've admitted, apologize, and perhaps...\\\", \\\"But lying might seem juvenile, so it's important to clarify what you did wrong to justify hurting someone in some way, and it can help to understand what it would mean if you didn't get the gift you deserve. [substeps] While it's tempting to blame someone for your sin, you shouldn't.\\\", 'Forgiveness is impossible if you don\\\\'t admit you did something wrong. [substeps] You may think, \\\" i guess maybe i shouldn\\\\'t have lied, but i had a really good reason and it was a small lie.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}