{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3a292ddf-0632-5345-bb10-57f26728cee4","task_key":"default--validation--2817","task_revision_id":"1","upstream_id":"2817","short_description":"HellaSwag validation 2817","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to manage your dog's bladder stones [title] Feed the dog food recommended by or prescribed by the vet. [step] This isn't a complete answer but it is a good start. [title] Be wary when your dog starts getting a lot of infections.\",\"endings\":\"['[step] These may be a sign that the bacteria causing the infections has become a substrate for the calcium and oxalate crystals. These tend to stick to and snowball into sizable stones.', '[step] On the other hand, do not be alarmed if an infection develops. As something that is rare, but irritating, it does not cause an outbreak and the vet will not diagnose it.', '[step] About 30% to 60% of dogs with tumors develop these infections and rarely become fatal. Tumors can be difficult to treat, but severity is usually life-threatening.', '[step] Over time, fleas and ticks can cause bladder stones. As soon as your dog stops and changes his habits, get him vaccinated.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}