{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"086f7302-7f07-50bb-8d65-771e8fc595e5","task_key":"default--validation--790","task_revision_id":"1","upstream_id":"790","short_description":"HellaSwag validation 790","config":"default","split":"validation","body":"{\"activity_label\":\"Computers and Electronics\",\"ctx\":\"[header] How to avoid internet addiction [title] Admit you are at risk of an addiction. [step] More and more people in the world are becoming addicted to the internet. You are not the only one with this problem, it is becoming more and more common and more and more well known.\",\"endings\":\"['This may seem like a good point but with this problem you may want to open up and talk to someone you trust. Even if you would not be comfortable having an anonymous conversation with someone you trust, it is still important to be clear that what you are experiencing is a form of internet addiction.', 'Do not be embarrassed; find others with the same problem and help each other beat it. [title] Set aside limited time for computer use.', 'Understand that it is okay to not be able to lose yourself to this activity but that life without internet addiction can be not sustainable. So suffering from this problem alone or with others entails a growing struggle in your life.', '[substeps] Do not let internet addiction isolate you from friends and family. The fact that you are addicted to the internet may mean you need to decide to cut back on your daily and weekly choices.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}