{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e43171d9-e425-5219-8836-5e123a3913e4","task_key":"default--validation--24324","task_revision_id":"1","upstream_id":"24324","short_description":"HellaSwag validation 24324","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to keep a parenting journal [title] Write consistently. [step] When keeping a custody journal, it's imperative that you write in it regularly in order to make it as reliable and authoritative as possible. By recording information every day--or even several times a day--you can be sure that what you are writing is as accurate and useful as possible.\",\"endings\":\"['[title] Review your journal every night before bed. [step] For one thing, your journal may come to an end, in which case, in order to keep track of what you are doing you will need to rewrite it.', '[substeps] Consider starting your journal with pictures, notes, and any other information that comes to mind during your interactions with your ex. Think about whether you have questions or need more information.', '[substeps] If you write less often, you run the risk of being vague and nonspecific. You may also simply forget details you meant to record.', 'A good rule of thumb is to keep track of your journal entries. [substeps] Keep the entries in your original journal and try to keep your xeroxed journal as detailed as possible.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}