{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"87bcc838-92fb-5a49-a3e1-9ae32ef4e5fd","task_key":"default--validation--45910","task_revision_id":"1","upstream_id":"45910","short_description":"HellaSwag validation 45910","config":"default","split":"validation","body":"{\"activity_label\":\"Food and Entertaining\",\"ctx\":\"[header] How to tune a bass guitar [title] Play the e note on an instrument. [step] You'll want to make sure that the instrument you are tuning to is in tune before tuning to it. Some instruments, like the piano, stay in tune for long periods of time and are excellent tools for tuning your bass.\",\"endings\":\"['[substeps] The e note on a keyboard can be found by locating the white key immediately after a series of two black keys in a row. Any key immediately after a series of two black keys is e.', \\\"Stick with intervals when pushing a bass string, and practice developing a regular tempo rather than leaving the input blank. If you are in tune by listening to recordings of a singer's songs, music samples, youtube videos, or other recordings, it is likely that they have a full range of note orders.\\\", '[substeps] Both electric and acoustic bass guitars come with e tuners. If you opt for e tuners, the bass should be tuned to an old-fashioned f tone (canon) using some of the same techniques.', 'However, some instruments, like the saxophone and clarinet, require you to play the entire instrument at once to check the tuning yourself. [substeps] If it needs to be tuned, play \\\" a \\\" at the back of the score sheet.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}