{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e3984d3b-4524-5326-9b79-353137d94eee","task_key":"default--validation--32832","task_revision_id":"1","upstream_id":"32832","short_description":"HellaSwag validation 32832","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to relactate [title] Consider the time frame. [step] Your odds of success mostly depend on how old your baby is and how long it's been since you initially stopped breastfeeding. Your genes will also determine how feasible relactating is.\",\"endings\":\"[\\\"[substeps] If a baby starts gaining weight, your odds of successfully relactate might be two to three years old. A baby's immune system is strong enough to handle those two pounds, but breastfeeding may require additional genetic testing.\\\", 'Ideally, relactate is best during the breeding season. Often, newborns will outgrow their mothers.', '[substeps] Some women are very comfortable and get pregnant almost immediately. Others like to wait a year or two, especially in the early stages of parenthood.', '[substeps] It is easiest to relactate if the process is started within three weeks after the birth of your baby. After that period, prolactin levels drop dramatically.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}