{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a9a2f18d-2790-5cd6-925b-787d87747c04","task_key":"default--validation--28681","task_revision_id":"1","upstream_id":"28681","short_description":"HellaSwag validation 28681","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to find an animal law attorney [title] Talk to your friends and family. [step] People you know and trust can be your best sources when looking for an attorney. [substeps] Keep in mind that, depending on your situation, attorneys in other practice areas such as personal injury may be able to assist on your animal law case.\",\"endings\":\"['However, make sure those you talk to are clients rather than attorneys. Even if an attorney is a close friend or family member, you still cannot count on an expert on your animal law.', 'Additionally, attorneys know other attorneys, and may be able to recommend someone who would be good for your case. Be careful about relying too much on word of mouth.', 'If the judge or jury will grant your motion, speak to them beforehand to find out what their discretion and experience is about hiring an attorney. In addition to asking for referrals, you can find people who have had their teeth filed recently.', 'Even people in animal rights groups, such as community associations or civil rights groups, may be open to help on your animal law case. Regular contacts may be particularly helpful if you hear of animal law cases involving children.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}