{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"af453485-bc07-51f4-b59a-a936ba7818f4","task_key":"default--validation--13856","task_revision_id":"1","upstream_id":"13856","short_description":"HellaSwag validation 13856","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to play an active role in your child's education [title] Monitor schoolwork. [step] Taking an active role in your child's education can be very beneficial in helping her succeed. One of the most important things you can do is to pay attention to what she is learning in school.\",\"endings\":\"['Keep track of what subjects she is studying and monitor the assignments she is working on. [substeps] Younger children tend to bring home projects, worksheets, and information from the teacher.', 'This means paying close attention and following along closely to each lesson so that you are not getting bogged down in student life or doing extracurricular activities. Paying extra attention in class and in your everyday schedule can help ensure that you are working correctly and make your child feel confident that she is contributing.', 'Take note of which assignments your child is participating in and what she is doing the most. [substeps] Be transparent about what you see and feel about your child in the classroom.', 'This can help establish the acceptable behavior for her in the classroom. [substeps] Ask your child for specific tips on how to take good notes in the classroom.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}