{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"272e9b31-f29e-52ef-abe4-3252e3010a0e","task_key":"default--validation--38283","task_revision_id":"1","upstream_id":"38283","short_description":"HellaSwag validation 38283","config":"default","split":"validation","body":"{\"activity_label\":\"Education and Communications\",\"ctx\":\"[header] How to get an editor to notice you [title] Read and follow the publication submission guidelines. [step] Publications create submission guidelines to make it easier on both writers and editors. By reading and following the guidelines, you're producing work that the publication is looking for, making it easier on you as a writer, in a format that its editors can more easily vet for suitability and quality.\",\"endings\":\"[\\\"[substeps] Avoid completely blocking the publication's name and publishing page. If the publication isn't very artistic, they may avoid publication altogether.\\\", '[substeps] Make sure that your article followed these guidelines when applying for an editor position. Some positions will require you to provide a specific amount of work to earn an editor position, while others will require a minimum of 30 work hours.', \\\"[substeps] Most publications with an internet presence offer their submission guidelines on their websites. For those that don't, you can obtain the guidelines by writing to the publication at the address given.\\\", '[substeps] Ask the authors at the bottom of the publication to share your work on an ongoing basis. Highlight key aspects in your submission to keep them from alienating you from the publication.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}