{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4269327f-2255-5af0-895b-88e31d948618","task_key":"default--validation--32639","task_revision_id":"1","upstream_id":"32639","short_description":"HellaSwag validation 32639","config":"default","split":"validation","body":"{\"activity_label\":\"Youth\",\"ctx\":\"[header] How to avoid being cyberbullied [title] Don't post anything online you want to keep private. [step] Private messages, pictures, texts, and other content aren't truly private. Once they're out there, a bully could get of a copy and use it to harm you.\",\"endings\":\"['If you let yourself or other people online post whatever it is online, be sure to keep this information confidential and avoid sharing it to others. [substeps] Keeping online posts private is important; anyone could find out without having the decency to check the information.', 'It\\\\'s best not to post anything inappropriate, embarrassing, or overly personal online. [substeps] Try the \\\" grandma test \\\" as a rule of thumb: before sharing anything online, ask yourself if you would also show it to you grandmother.', '[title] Drink something at least three times a day. [step] It will keep you hydrated and keep you physically and mentally healthy.', 'People online talk about how they think you\\\\'re \\\" cool. \\\" it isn\\\\'t your right to share information like that.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}