{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"04237115-912e-5e16-9bb1-b79ba8662923","task_key":"default--validation--8845","task_revision_id":"1","upstream_id":"8845","short_description":"HellaSwag validation 8845","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to talk so teens will listen [title] Remove distractions to make listening easier. [step] Getting your teen to listen is much easier when you aren't competing with their cell phone or the television. Eliminate these distractions and your message is more likely to actually be heard.\",\"endings\":\"[\\\"[substeps] If you're in a class, ask a teacher to remind your teen to turn off all phones during class. You can still provide them with distractions if they just want to take their mind off of school.\\\", '[substeps] Decide which (or all) distractions will help your teen hear more clearly. Let your teen hear the message from another part of the house, from a windowsill outside, or in rooms that are quiet.', \\\"[substeps] When you're planning to talk, turn off the tv and ask your teen to silence their phone or leave it in another room. If your teen is the type to feel intimidated by face-to-face discussions, try chatting with them during tv commercials.\\\", '[substeps] Research shows that some teens prefer to be ignored or...without a distraction. Keeping the screen fairly up will help correct that.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}