{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"bd5b1f2f-899c-5cad-8169-0a6a3cf78f43","task_key":"default--validation--32406--variant-a260a3e6e5a4","task_revision_id":"1","upstream_id":"32406--variant-a260a3e6e5a4","short_description":"HellaSwag validation 32406","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to get rid of a dry throat [title] Drink plenty of fluids. [step] As a general rule of thumb, you should be drinking eight 8-oz (250-ml) glasses of water and other hydrating fluids each day. [substeps] Staying hydrated gives your body the resources it needs to produce the amount of saliva needed to keep your throat moist.\",\"endings\":\"['Additionally, drinking fluids can also thin and loosen mucus, thereby preventing it from clinging to the interior walls of your throat and causing irritation there. Tea can be an especially good beverage choice for those suffering with dry throats.', 'This will help to keep the saliva present. We have tried to treat this by redistributed brain activity throughout the day.', 'This can help prevent any congestion you might experience. You can get a standard 8 8-oz glass of water every 1-2 hours, but you may need more or less depending on your age.', 'A warm, damp coat will also help replenish your capillaries. [title] Modify yourself when dealing with hot flashes.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}