{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"daabc28d-0f18-5a50-ba0e-e4704ab82c8a","task_key":"default--validation--33517","task_revision_id":"1","upstream_id":"33517","short_description":"HellaSwag validation 33517","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to introduce wheat to your baby [title] Introduce solids at 4 months. [step] If your child is transitioning from liquid foods to solids, then you can start feeding them wheat at this time as well. Most children start this transition between 4-7 months.\",\"endings\":\"[\\\"Adding wheat into your baby's diet at this point helps to give them additional calories and nutrients, such as folate. [substeps] Giving your baby potentially allergenic foods, such as wheat or eggs, early on can actually help them to avoid food allergies later on in life.\\\", 'At this point, your baby will start to develop motor skills and habits, so some of these skills may need replacing. [substeps] Let your baby feed solids at 7 months.', 'Even though no solids are introduced, moderate to large amounts (approximately 2 liters) are required to give them a solid base. [substeps] You can gradually introduce wheat to their stools as a last resort.', '[substeps] You may want to feed them 4 extra batches of liquid food for two feedings, then 3 more servings at 4 months. [title] Add at least half of a hearty greek stir-fry to each individual meal.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}