{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ed2d1ac2-09b1-51ba-a91b-8c69b32c7aed","task_key":"default--validation--33956","task_revision_id":"1","upstream_id":"33956","short_description":"HellaSwag validation 33956","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to treat a sore throat after throwing up [title] Drink water or other clear fluid. [step] Drinking a bit of water after you throw up can ease the discomfort of a sore throat as well as helping you avoid dehydration. The water can help to get rid of excess stomach acid that can coat your throat when you throw up.\",\"endings\":\"[\\\"[substeps] If you still have an upset stomach, drink water slowly and don't drink too much of it. In some cases, filling the stomach with too much water or drinking too quickly can cause you to vomit again.\\\", \\\"[substeps] Water and an electrolyte-neutralizing beverage work well when preparing a sore throat beverage. Be sure to choose water as the beverage and follow the manufacturer's safety recommendations.\\\", 'Drinking enough water may help expel some of the bacteria that causes nausea and vomiting. These bacteria are what make your cold sore sore.', '[substeps] Ideally, you should drink at least 8 to 12 glasses of water a day. This water can help replace electrolytes in your system.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}