{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3c61dab6-9414-59b0-9543-98b08ec5b33a","task_key":"default--validation--24751","task_revision_id":"1","upstream_id":"24751","short_description":"HellaSwag validation 24751","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to stop your throat from hurting [title] Stay hydrated. [step] Drink a lot of water and other liquids designed to replenish nutrients in your body. Sports drinks are normally great options.\",\"endings\":\"['They rehydrate you fast and come in great flavors. [substeps] Drinking a lot of liquids can also help wash away thin layers of mucus or other allergens that may have coated your throat, resulting in inflammation and discomfort.', 'However, make sure to stay hydrated and avoid sugary drinks, which make you tongue-tied. [substeps] Adding sweetened beverages can actually help to make your throat feel more manageable and less scratchy.', 'Some examples of sports drinks are : [substeps] Water sports drinks. Sports drinks offered by sports teams coffee and tea sports drinks.', \\\"Carbonated beverages such as seltzer and gatorade, for instance, are also excellent options because they're high in electrolytes (a sugar your body needs to produce). This will help keep your throat from getting sore.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}