{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0b5e681f-b467-5015-9911-2379fbeb10a9","task_key":"default--validation--27258","task_revision_id":"1","upstream_id":"27258","short_description":"HellaSwag validation 27258","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to use wedding cameras on tables [title] Read any instructions on the camera, you may be unfamiliar with operating a camera with film. [step] No doubt the couple have paid a fortune to hire an official photographer for their wedding. The single use cameras left on the tables can be used for less formal images and spontaneous moments.\",\"endings\":\"['Anything that requires little to no practice might not work well for an impromptu wedding. [title] Use the laser or uv mode shots to create a dark plane effect on the table.', '[title] Find a table underneath the bouquets. [step] It is better to sit at a table underneath the bow to use one of these when the food is being served and you just want to look like the bride.', '[title] Check how many exposures the camera film has. [step] Knowing how many pictures are left will help you to try only for the best shots, so as to not waste any.', '[title] Set up a tablecloth on the table. [step] In order to purchase for your guests based on your budget, use a tablecloth in the same color scheme as the wedding gowns you are using.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}