{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"07abc488-7cae-5fc9-ab01-d4ea1bfed675","task_key":"default--validation--4997","task_revision_id":"1","upstream_id":"4997","short_description":"HellaSwag validation 4997","config":"default","split":"validation","body":"{\"activity_label\":\"Pets and Animals\",\"ctx\":\"[header] How to pack and move your bird [title] Visit your veterinarian. [step] Before you make any arrangements to move with your bird, you will need to have it checked out by a veterinarian. This will help you determine if it is healthy enough to travel.\",\"endings\":\"['Make an appointment at your local animal shelter or pet supply store. Bring your bird to be looked at closely by a vet certified by the avian national certification commission for the certification of birds.', 'It can also help to determine if it needs any blood thinners. You will also need to get a detailed medical history.', 'They may also give it a medical exam to rule out other illnesses. [substeps] Your doctor will recommend other causes of illness, such as infection, malaria, diseases, conditions that may affect her ability to talk, or the different ways in which her breath smells.', 'Your vet will evaluate your bird and likely provide you with tips to help it stay healthy during the move. [substeps] Your doctor may suggest that you begin giving your bird immunity and digestion-boosting supplements a month before you move.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}