{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ac4a97ef-9a65-5b8d-805b-8e4a9b28ccaf","task_key":"default--validation--33496","task_revision_id":"1","upstream_id":"33496","short_description":"HellaSwag validation 33496","config":"default","split":"validation","body":"{\"activity_label\":\"Computers and Electronics\",\"ctx\":\"[header] How to do a voice over [title] Write out a script. [step] If you are doing commentary on something, like a youtube video, you should at least view the video several times to get a feel for what happens. For all other voice overs a script is essential.\",\"endings\":\"[\\\"You need to know how long you have to talk, if you are responding to any characters or cues in the video, and what you're going to say. This script may change when matched with the final video, but you can never go wrong with a little pre-planning.\\\", 'Because you want your voice to be heard on all forms of video, you should try to write it professionally. [substeps] Do not write \\\" i\\\\'m in a fight scene \\\" or \\\" the other girl leading him around the room.', 'All overs require large spaces, so the space needs to fit in between each voice one meter away from each other. Think of these as pathways to explore and move forward within a voice.', \\\"( make sure that your script is at least a mile away from your interview. ) [substeps] Write a script in black-and-white, or white-color, if you're script is not black and white.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}