{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0f2918f4-e92b-5099-8298-d968db141b7f","task_key":"default--validation--11980","task_revision_id":"1","upstream_id":"11980","short_description":"HellaSwag validation 11980","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to serve healthy and appealing toddler snacks [title] Choose kid-sized foods. [step] When you're looking for nutritious foods to feed your toddler, you need to make sure you pick appropriate foods. Choosing items that are small in size or that are \\\" toddler-sized \\\" will be helpful.\",\"endings\":\"[\\\"[substeps] Toddlers need to have smaller sized foods. Their hands, fingers, mouth and teeth are smaller than adults'.\\\", \\\"[title] Look for baked goods at the grocery store. [step] Look for foods that are a little higher in calories or have more protein, as these will add up better to your toddler's nutritional needs.\\\", \\\"Add large items, like yogurt, fruits, vegetables and grains to your toddler's snack tray. [title] Add toddler-sized meals to the snack tray.\\\", \\\"Child-sized foods are small and usually only have a small amount of added starch. That way, if your toddler doesn't want to eat something, you can ask if it's snack-size for him/her.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}