{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7f1261f8-18f1-5741-a85c-b398c6b192ac","task_key":"default--validation--47469","task_revision_id":"1","upstream_id":"47469","short_description":"HellaSwag validation 47469","config":"default","split":"validation","body":"{\"activity_label\":\"Education and Communications\",\"ctx\":\"[header] How to handle skipping a grade [title] Consider your feelings about skipping a grade. [step] If you are the student who will be skipping a grade, you need to carefully examine the advantages and disadvantages of moving up a grade since you will be the one most affected. If it's not something that you are comfortable with or happy about, this will make the process more difficult.\",\"endings\":\"['You may have to readjust your grades carefully to avoid stressing out if you do not give yourself enough time to cooperate in the process and make sure you complete your work. [substeps] Do not progress to skipping one grade without speaking to a teacher.', 'Your teachers will be able to provide you with guidance on how to handle the problem more effectively as a result. [substeps] Dwelling upon or dwelling on your feelings can make a huge difference in your overall well-being.', '[substeps] Try to think about how this decision might impact you in the future. For example, if you are interested in participating in sports, being younger than other students might make it harder to compete on the same level.', '[substeps] Some students may be resentful or even ignore the request. In these cases, concern your concerns a bit more.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}