{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6772a417-2db2-5706-be99-2bd6ca96ad21","task_key":"default--validation--27013","task_revision_id":"1","upstream_id":"27013","short_description":"HellaSwag validation 27013","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to avoid being overwhelmed by information [title] Take a tech break. [step] If you feel like you're starting to drown in information, the best way to get your feet back on solid ground is by turning off the faucet. Every single day, get away from both your phone and computer for an hour or two.\",\"endings\":\"['You can spend this time reading articles and researching courses on a laptop or your smartphone. [substeps] In addition to some tech free time, taking a 15-30 minute break can take you away from your home.', 'Or, stop by a cafe and sit down with your laptop and read a book. You\\\\'re less likely to \\\" cycle through \\\" your email, texts, and personal data.', 'When asked to \\\" use the bathroom, \\\" keep your phone and any other work electronics out of sight. [substeps] The point of this is to keep yourself occupied and focused.', 'For many people, this simple task seems almost unthinkable. In fact, the harder this may seem, the more likely you will benefit from taking a break.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}