{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5d8b15c9-9e9a-54f5-9aa0-ae7077a58c08","task_key":"default--validation--20377","task_revision_id":"1","upstream_id":"20377","short_description":"HellaSwag validation 20377","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to stop a player from hurting you [title] Know the psychology. [substeps] Players are doing it for control and immediate gratification, because they do not feel worthy of anyone's love. They need to continuously boost their ego, which is done in many ways: getting your love, making you jealous of them, pointing out your flaws and etc.\",\"endings\":\"[\\\"These behaviors abate the sense of power and control they have over other players. A player doesn't need to be a good player to have the power of his ego on display; he just needs to feel satisfied to demonstrate this power.\\\", \\\"Earning as much as possible doesn't provide anyone with the positive energy they need. The main purpose of a play is to make a player feel like a winner and possibly be a thousand times better, not much better than an attack.\\\", 'They have issues from previous bad relationships and take their anger out on their victims. [title] Do not become a bully-replace your anger and jealousy with pity.', \\\", so that your ego may not even get the best of you. A good player isn't afraid to take a risk sometimes.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}