{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7c77e517-8f72-5d0a-8826-f814d6effa40","task_key":"default--validation--34154","task_revision_id":"1","upstream_id":"34154","short_description":"HellaSwag validation 34154","config":"default","split":"validation","body":"{\"activity_label\":\"Computers and Electronics\",\"ctx\":\"[header] How to get top comment on facebook pages [title] Comment. [step] But make sure they are never off-topic. It is a common misconception that funny comments only make it to the top comment.\",\"endings\":\"['Not everyone likes the people on the bottom and send unliked comments. To avoid this here, try to comment as little as possible each time you see the top comment on facebook.', 'On the other hand, if your comment pertains to that topic of the post, it greatly increases the odds of you hitting the limelight. You surely would not get appreciated for cracking a racist/sexist joke on a human rights page.', \\\"[substeps] Twitter can be a site and post about what is great on facebook. But chances are it's best to save your posts for the back-up posts (e.g.\\\", '[title] Offer to comment, as the answer is full of added drama, and there are no \\\" playphones \\\" on facebook. [step] -- but if they are, offer the highest quality to everyone.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}