{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"74723b9c-317c-5066-aaa0-1f40a1fd5ab4","task_key":"default--validation--43899","task_revision_id":"1","upstream_id":"43899","short_description":"HellaSwag validation 43899","config":"default","split":"validation","body":"{\"activity_label\":\"Food and Entertaining\",\"ctx\":\"[header] How to make almond milk tea boba [title] Order or buy tapioca pearls. [step] If you do not have an asian market in your town, they can be found easily online by conducting a search engine inquiry. You may also find them at tea shops in some cities.\",\"endings\":\"['[substeps] The tapioca pearls are not as exotic as the other types. Some countries and regions offer bulbasaur pearls, which are available for purchase through costco and zapius.', 'Make sure to order whole \\\" using this fresh grind \\\" tapioca pearls as they contain ethylene and vitamin c, which act to make beets. [title] Cut the boba pearls into small pieces.', '[substeps] Tapioca pearls may even come with an ingredient called tapioca coal. Purchase kosher walnut kernel pearls if you want to make almond milk tea.', '[substeps] Do not buy quick-cooking boba, for best results. This tapioca is usually used as a thickener for soups, casseroles and stews.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}