{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"edf35b0e-82c6-508d-83a2-d361391075b3","task_key":"default--validation--26401","task_revision_id":"1","upstream_id":"26401","short_description":"HellaSwag validation 26401","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to improve your child's poor homework performance [title] Be prepared. [step] It will be easier for you to provide help with your child's homework if you know what they are working on. This way you can review any concepts you aren't familiar with beforehand.\",\"endings\":\"[\\\"[substeps] Most questions people ask on an assignment don't result in a satisfactory outcome. Stick to the original assignment and go back and evaluate what you understand later.\\\", \\\"You can also gather any supplies and materials that will be needed to complete their homework. [substeps] If possible, review their assignments or agenda so that you'll know what they are learning in each class.\\\", '[substeps] If your child ever wants to try an easier subject, you are ready to help them. If they make an assignment, let them know.', \\\"[substeps] If you don't have a computer you can prepare their work for them from home. Provide a folding mat, printer paper and a stack of unused assignment material to make it easier to work on.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}