{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"04c8172d-de28-5a28-917a-afe94ed07392","task_key":"default--validation--49981","task_revision_id":"1","upstream_id":"49981","short_description":"HellaSwag validation 49981","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to force a burp [title] Drink a carbonated beverage. [step] Soda, beer, sparkling water, champagne, or other carbonated beverages contain gases. This is what makes them bubbly.\",\"endings\":\"['Carbonated water helps to ease abdominal pain and refills the esophagus. It also draws out extra electrolytes from the stomach, resulting in bigger, more draining meals.', 'The carbonation in soda can make the burp hurt. [substeps] Other beverages require the body to compensate for the carbonation in a burp.', \\\"Since soda contains multiple chemicals, soda is highly recommended to help lubricate your esophagus, so don't limit yourself to alcohol-free water because it increases the fizz and swelling associated with a burp. However, there are many different types of carbonated drinks and your taste buds should be adjusting to these as your food remains empty.\\\", \\\"If you drink this sort of beverage, then, the gases will build up in your stomach and more than likely trigger a burp, which might help to relieve your abdominal discomfort. Try it! [substeps] Don't just drink the beverage-chug it.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}