{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"92dc99ae-5165-5d07-a299-57c7de4da935","task_key":"default--validation--34302","task_revision_id":"1","upstream_id":"34302","short_description":"HellaSwag validation 34302","config":"default","split":"validation","body":"{\"activity_label\":\"Pets and Animals\",\"ctx\":\"[header] How to measure a saddle [title] Learn what the bars are. [step] When you're looking at new saddles, one of the things you'll need to pay attention to is the bars. The bars are the weight-distributing foundation for the saddle; the part of the saddle that rests on the horse and holds you up.\",\"endings\":\"[\\\"There are two' bars' that distribute weight evenly on either side of the spine. If your saddle is well-fitting, the horse's back will be in contact with the entire length of the bars.\\\", \\\"Most new saddles have bars on their backs that hang to the sides. [substeps] If your horse's saddle only has bars, flip the bars over so that the back is facing away from you.\\\", \\\"The bars are located at the top of the horse and at either end of the saddle, which are the sides that you'll almost touch. [substeps] The bars range from two-hundred-200.\\\", \\\"While the bars are peerequisite for the saddle, they're also useful if you want an added comfort. [substeps] For a standard saddle, half of the weight on the bar weights toward the seat rather than the rear.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}