{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ca70c309-264c-59ef-9557-e61a8b8430e0","task_key":"default--validation--32726","task_revision_id":"1","upstream_id":"32726","short_description":"HellaSwag validation 32726","config":"default","split":"validation","body":"{\"activity_label\":\"Youth\",\"ctx\":\"[header] How to approach an unfair teacher to change your grade [title] Think about this particular teacher. [step] Have they been known to stand firm with their grades? Have they been unfair in the past? Thinking about these things will help you formulate your method for approaching the teacher. [title] Ask for opinions from others.\",\"endings\":\"[\\\"[step] You should be able to ask members of your class for any opinion you want. Even if you have no one to talk to you when you're not at home, you should have a trusted, non-judgmental group which will support you when you need it.\\\", \\\"[step] Whether it be a family member, or a friend who's amazing at the subject you're in, getting a second opinion is important. They can tell you what they feel your grade should be.\\\", '[step] Enlist the help of friends, family, or teachers if you are shy. [substeps] Generally you should only ask teachers that you feel comfortable talking to.', '[step] Friends, teachers, and colleagues are all good examples. Or, just ask people that you know who know the teacher well.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}