{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5665aa36-42e3-5574-9393-91467a1676c9","task_key":"default--validation--14646","task_revision_id":"1","upstream_id":"14646","short_description":"HellaSwag validation 14646","config":"default","split":"validation","body":"{\"activity_label\":\"Pets and Animals\",\"ctx\":\"[header] How to find safe placement for your cat after foreclosure [title] Ask friends or family to take your cat. [step] If you've been foreclosed on, the first people you should ask to take your cat are those closest to you. Since they care for you and best understand what you're going through, your friends and family will probably be willing to help you care for your cat.\",\"endings\":\"['Offer to pay for your cat\\\\'s expenses. [substeps] For instance, you might ask your mother, \\\" mother, would you be willing to look after my cat? I think it really likes you.', '[title] Buy a new home equity insurance policy. [step] If you want to protect the home when you sell it, you might try purchasing a home equity insurance policy from a local health insurance company or the environmental protection agency.', '[title] Look online for a \\\" professional \\\" site. [step] There are a variety of professional sites like restock, scripps, animal crossing and others.', 'It can be hard to have a successful foreclosure done without your own friends and family. [substeps] Approach the one closest to you and ask to have them bring your cat in.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}