{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0ebf77f4-2b29-5857-a3d6-ed8a35544460","task_key":"default--validation--6795","task_revision_id":"1","upstream_id":"6795","short_description":"HellaSwag validation 6795","config":"default","split":"validation","body":"{\"activity_label\":\"Computers and Electronics\",\"ctx\":\"[header] How to take action for violation of an injunction [title] Make sure you're safe. [step] Before you take action for violation of an injunction, take care that the incident is over and the threat to your safety or the safety of others has ended. If you fear for the immediate safety of yourself or your loved ones, call 911.\",\"endings\":\"['Only tell the police if you think someone hurt you or needs immediate assistance. [substeps] You may also want to consult an attorney if you think the threat of an injunction applies to you.', \\\"If you're concerned for personal safety, and need to protect yourself or others, call a local police station or other emergency number. [substeps] Remember that an injunction is a vague sentence or term.\\\", '[substeps] If you call 911, make sure you have a copy of the order when police arrive. You should keep a copy of the injunction on your person at all times.', 'If you fear for the immediate safety of others, call 411. In virginia, this number is 800-467-8255 or 800-273-6522.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}