{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d9220e0d-2a3d-5acb-b23b-a792176677f4","task_key":"default--validation--18141","task_revision_id":"1","upstream_id":"18141","short_description":"HellaSwag validation 18141","config":"default","split":"validation","body":"{\"activity_label\":\"Food and Entertaining\",\"ctx\":\"[header] How to relic a guitar [title] Remove the strings. [step] Before getting into modifying the appearance, you'll need to remove the strings. Unwind the strings if they're relatively new.\",\"endings\":\"[\\\"When you clean out the frets you're going to need to remove the strings with a pumice stone or hand sandpaper. If your neck and body are dry, you can use any kind of sandpaper.\\\", \\\"This will reveal the shorter strings running up and down the frets. Sometimes fender guitars reach whatever look they're after; you can experiment with the look by removing the strings in every time.\\\", \\\"Then use a ratchet wrench to loosen each string individually. [substeps] Be sure to start at the lowest fret of your favorite tuner, as you're unlikely to get over the sixth fret.\\\", \\\"If they're old and the string slack has already been removed, then snap them off with wire cutters. [substeps] Aged strings won't add any benefits when you relic your guitar.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}