{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"dd1cd55c-7262-5e77-9fcc-056e9dca09aa","task_key":"default--validation--37953","task_revision_id":"1","upstream_id":"37953","short_description":"HellaSwag validation 37953","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to set texting boundaries for your teen [title] Consider how to talk with your teen. [step] You'd be hard pressed to find someone today who hasn't heard about how unsafe texting while driving is. But your teenager may not fully understand the scope of just how deadly this act is.\",\"endings\":\"['If your teen is helping you out, you may want to consider other routes. [substeps] Texts are designed to confuse teens with emails and other people.', 'Sitting them down and explaining that texting while driving is deadly and setting the boundary of prohibiting them from doing so may help them understand. [substeps] You might say, \\\" i know this device seems harmless, but it\\\\'s responsible for taking many lives.', 'If your teen is at home, they can usually have a chat-talk session about texting. However, if they have other responsibilities that take their attention away from texting, they may not even realize how dangerous texting can be.', 'Young teens need to know this before speaking. In the meantime, just listen to your teen and try your best to keep the conversation as civil as possible.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}