{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"eddc297f-3a28-5402-9f2a-7caca4014be7","task_key":"default--validation--21698","task_revision_id":"1","upstream_id":"21698","short_description":"HellaSwag validation 21698","config":"default","split":"validation","body":"{\"activity_label\":\"Computers and Electronics\",\"ctx\":\"[header] How to sing like kelly clarkson [title] Exercise your voice. [step] A way to do that is by holding a note for 10 seconds. Do that 5 times.\",\"endings\":\"['That is a true test of the vocal chords, and the note you are holding should be very steady and very clear. If your vocal chords are well controlled, your note should ring at a steady pace.', 'Try to scale the note up and down. Voila! Your voice will sound dramatically softer and monotone.', 'Try to do it for longer than this and your voice will generally sound softer. Also aim for heart noise, which sometimes occurs with the vocal chords.', \\\"If you reach a high note (as annoying as this sounds), you're probably faking it. Actually push yourself with your lungs to carry it up.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}