{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f3413f06-2fbb-56cc-84cb-1fa0b9a1df0c","task_key":"default--validation--25500--variant-f13e0ed467d4","task_revision_id":"1","upstream_id":"25500--variant-f13e0ed467d4","short_description":"HellaSwag validation 25500","config":"default","split":"validation","body":"{\"activity_label\":\"Food and Entertaining\",\"ctx\":\"[header] How to write a blog post [title] Research other blogs that are similar to your blog. [step] Get some ideas for your own blog by noting interesting and compelling details in other people's blogs. If anything, you'll also be able to determine what you don't like about someone blog! [substeps] For example, if you're creating a home and food blog, scroll through other popular home and food blogs.\",\"endings\":\"['You can get a great idea of who is on average living 200 minutes at home. Another step you can take is to create a blog with short blog posts.', 'If you find something that catches your eye, choose it and review it. Give yourself a time limit for the blog to be three or four good reviews.', 'You could say, \\\" monopoly board was the most popular monopoly board site for me over the years, \\\" and publish a list of all of your favorite communities. [title] Write a blog post with background information.', 'Notice the layout, content, and images on the other blogs. Pay attention to how long the posts are, the frequency of the posts, the writing style, and the subject matter.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}