{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b381a775-2907-59be-a3ca-fda2d6598933","task_key":"default--validation--33027","task_revision_id":"1","upstream_id":"33027","short_description":"HellaSwag validation 33027","config":"default","split":"validation","body":"{\"activity_label\":\"Home and Garden\",\"ctx\":\"[header] How to create a minimalist wardrobe for your kids [title] Make a list of how many clothes they need. [step] Before you begin, try to identify what types of clothing your child needs as well as how many of each they require. Factor in how often you do laundry to help you decide how many items of clothing you can get away with.\",\"endings\":\"['This can help show that your child feels useful and good about themself. [substeps] Use each day and day as a series of reminders that you both are contributing to childcare.', 'Planning how much clothing will come into the house will also help you decide on how many days and times to do laundry. [substeps] If you have large children, you may need to put aside a few days for the chore tasks.', '[substeps] For example, you may decide that they need seven casual shirts, three pairs of pants, one dressy outfit, two hoodies, a coat, a pair of sneakers, and two pairs of pajamas. The age of your child may also influence this decision.', '[substeps] You may want to consider getting your kids to keep a diary of the weight you provide or factoring in how much time they spend in between washes. Look at evidence of their behavior to get an idea of how much time they spend in between washes.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}