{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ec620674-ce23-528e-91f6-1e64dd5d0ac0","task_key":"default--validation--20211","task_revision_id":"1","upstream_id":"20211","short_description":"HellaSwag validation 20211","config":"default","split":"validation","body":"{\"activity_label\":\"Food and Entertaining\",\"ctx\":\"[header] How to play bassline when playing the piano [title] Find the key and accompanying chords. [step] Determine which key the piece is in, and learn the basic chords for each key signature. In a major key, the one, four, and five chords are always major, and together they make a common chord progression.\",\"endings\":\"['[substeps] Alternatively, you can find chords tuner, jokey, or syncopated. This is specific to the piece as well as to the melody.', 'Make your way down the keyboard until you find the four chords for each key. [substeps] If your chord is in, play the note progression key, then the chords numerical row with the two ascending steps.', 'For example, in the key of c major, you can play the c major, f major, and g major chords. [title] Play the root of each chord with your left hand.', \\\"In a minor key, there's a four-chord pattern that you can vary. [substeps] Note that if you are playing the keyboard at all, you may notice that you shuffle each chord in the same order.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}