{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a1d77597-8b5e-5c9f-8388-0b07fcd97413","task_key":"default--validation--36164","task_revision_id":"1","upstream_id":"36164","short_description":"HellaSwag validation 36164","config":"default","split":"validation","body":"{\"activity_label\":\"Pets and Animals\",\"ctx\":\"[header] How to stop feather plucking in lovebirds [title] Take your lovebird to the vet. [step] If your lovebird has started plucking out its feathers in an obsessive way that leaves bald spots, you need to take it to an avian veterinarian as soon as possible. Feather plucking can be caused by a medical condition or by stress.\",\"endings\":\"['[substeps] Feather plucking tends to be the most common problem birds have. If you notice your lovebird is especially fussy and agitated about trying to breath, you should take your bird to an avian veterinarian immediately.', 'Your vet can help you figure out the cause and how to treat it. [substeps] If you treat the feather plucking early, it may not turn into a habit.', \\\"[substeps] If your lovebird is currently plucking out its feathers, then you should take it to the vet. It's important to talk with your veterinarian before picking up your bird to eliminate possible feather plucking.\\\", 'You need to make an appointment with the veterinarian and get medical intervention that can prevent feather plucking. [title] Take your lovebird to a professional feather plucking expert.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}