{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8b28e451-b02d-5e72-8905-042f1884a7a8","task_key":"default--validation--44386","task_revision_id":"1","upstream_id":"44386","short_description":"HellaSwag validation 44386","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to decide whether to go abroad for dental treatment [title] Start your search on google or some other search engine. [step] Make a list of the clinics that are featured and that appeal to you. Remember the sponsored clinics have paid to be on the first position, they have not necessarily been selected by google as suiting your criteria.\",\"endings\":\"['[title] Find out how long the clinic has been offering treatment to overseas patients. [step] If they have been around a long time then they probably have a good track record.', '[title] Ask around for \\\" dentists for dental care \\\" posters or \\\" in-clinic treatments \\\" flyers. [step] Also, make sure you get the name of appropriate dr.', '[title] Leave notes at the clinic each day. [step] A written note is always needed in case you are unable to attend the appointment while you are away.', 'Checking the number of clinics you wish to visit and contacting them makes the decision much easier and easier. [title] Visit a conversation, tea or even facial shop to try to talk to a dentist, he or she will be able to check your dental work and provide you with mouth health options.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}