{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3e785e0a-5c53-501e-83da-cce8da0c6618","task_key":"default--validation--11185","task_revision_id":"1","upstream_id":"11185","short_description":"HellaSwag validation 11185","config":"default","split":"validation","body":"{\"activity_label\":\"Pets and Animals\",\"ctx\":\"[header] How to treat addison's disease in poodles [title] Be able to spot the initial signs of addison's disease. [step] At first the signs are vague. They include lethargy, intermittent diarrhea and vomiting, shaking, and muscular weakness, which makes it difficult to jump up on a favorite spot.\",\"endings\":\"[\\\"However, you'll have to be able to identify these signs along with knowing when the symptoms began. [substeps] Have your vet look at the blood clots and any drainage in the litter box.\\\", 'After a couple of days, the symptoms can go into more severe territory. [substeps] Symptoms usually start 2 weeks after you first take a supplement and vary based on your foods and physical activity level.', \\\"[substeps] These symptoms often wax and wane, which can make it hard to diagnose. It most cases, the adrenal glands gradually fail, as a result of attack from the poodle's own immune system.\\\", \\\"Then when signs persist the dog will become increasingly dehydrated and don't want to climb up. Your vet will definitely recommend that you notice this condition as soon as possible.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}