{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8c295c92-2516-59b3-b1be-e635429e5292","task_key":"default--validation--11409","task_revision_id":"1","upstream_id":"11409","short_description":"HellaSwag validation 11409","config":"default","split":"validation","body":"{\"activity_label\":\"Holidays and Traditions\",\"ctx\":\"[header] How to play altissimo notes on clarinet [title] Understand that these notes are pitched squeaks and probably won't be the most relaxing sounds to your ears for a while. [step] As you get used to the fingerings and air intensity, you can shape the sound to create a warmer tone. [title] Finger a top space e. [step] Then lift your top finger.\",\"endings\":\"['Then feel how the top space knuckle upon your finger brings air to the reed. You are now ready to play three notes without moving your finger at all.', 'Then, lift the top and rub the top of your top finger around the bottom of your top lip. This action works on most popular types of notes, from oboe to symphonic scale.', 'This will be your first altissimo note. Meet c! [title] Finger a top line f.', 'Place the tip of the thumb on the top space e on the clarinet. This, in turn, mimics the lift of the fingers on the other keys.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}