{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ecd397a3-b400-5c43-9f33-17a959e9819f","task_key":"default--validation--30001","task_revision_id":"1","upstream_id":"30001","short_description":"HellaSwag validation 30001","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to talk to a child about a bad grade [title] Explain the problem to the child how they would understand it. [step] Tell them that without good grades, many people won't be interested in hiring them for a job when they grow up. [title] Avoid negativity.\",\"endings\":\"[\\\"[step] This doesn't help children with adhd find employment. Make sure your concern regarding a problem goes beyond what adults would actually say.\\\", '[step] It\\\\'s fine to be upset with your child, but calling him/her a \\\" failure \\\" or commenting on his/her \\\" stupidity \\\" will only cause a decrease in self esteem. Degrading remarks can hurt more than you know.', '[step] Studies show that most people actually want to work, even before they reach 3 years old. [title] Tell the child why they need a job.', '[step] Since preschool age children cannot achieve success in school and some teachers are no longer motivated to work with them, they may feel incomplete or powerless to make their students feel successful. Stay calm and upbeat that the child is competent and capable of making good grades.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}