{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c704e072-d29b-5b23-a486-0ad0ea47585a","task_key":"default--validation--30748","task_revision_id":"1","upstream_id":"30748","short_description":"HellaSwag validation 30748","config":"default","split":"validation","body":"{\"activity_label\":\"Computers and Electronics\",\"ctx\":\"[header] How to be a good texter [title] Know your phone. [step] Mobile phones and tablets have become extremely powerful and convenient but can be tricky to master. Phones sometimes offer different ways of texting.\",\"endings\":\"[\\\"When you aren't using it, take some time to download an app and use it as a messaging tool. Without, you would be messaging something completely different.\\\", \\\"Do not hesitate to ask your crush what it takes to be a good texter. [substeps] Older apps like messaging if you're stumped, and commercial (iphone, android) systems enable them.\\\", \\\"Make sure to read the manual and allow yourself a few hours to explore all the options. Once you're comfortable with one, train your fingers to type or swipe quicker and think about the position of your hand.\\\", 'If you use one the most, new website offers many tutorials on basic texting and ask your parents for recommendations if you want one. You can also customize your phone to reach more people.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}