{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4fe3f9b5-935e-5199-b573-5168b39f5aad","task_key":"default--validation--42695","task_revision_id":"1","upstream_id":"42695","short_description":"HellaSwag validation 42695","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to prepare your children for a visit to the doctor [title] Tell them about the appointment a day or two in advance. [step] You might think that keeping your child's doctor's appointment a secret until the day of will keep them from making too big a deal of it. However, springing a doctor's appointment on your child might actually make it more stressful than it needs to be.\",\"endings\":\"['Have a family meeting the day your child receives their appointment, and give them a call to see how their visit went. [substeps] If possible, have your children talk to doctors before you hand them the appointment packet.', \\\"Letting your child know they have a doctor's appointment coming up a couple days in advance can help lessen their anxiety about it. [substeps] Tell your child about the appointment only one or two days in advance.\\\", 'Try to be as specific as possible and explain the appointments for your child so they can see the doctor without the need to worry. [title] Arrange a ride home from school the day of the appointment.', \\\"This is why waiting will not be the best option unless you understand your child's medical condition well. You want to make sure you have a reasonable working relationship and remain patient throughout the visit.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}