{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9255e7d1-2916-5a64-a644-e6ee85118310","task_key":"default--validation--13416","task_revision_id":"1","upstream_id":"13416","short_description":"HellaSwag validation 13416","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to feed your child enough vitamin b [title] Feed your child vegetables high in folate. [step] Many vegetables are rich in folate. Asparagus, spinach, brussels sprouts, and avocado all contain significant amounts of folate.\",\"endings\":\"['Feed your child these foods to keep their folate levels high. [substeps] For instance, ½ cup of black-eyed peas contains about 100 micrograms (mcg) of folate.', 'Broccoli, carrots, kale, plums, pumpkins, and peas all contain a variety of folate. [substeps] Do not feed your child leafy greens, like beets or cucumber.', '[substeps] Eating leafy greens like sweet potatoes, pumpkins, mushrooms, and cucumbers are popular vegetables for children. One on one time with your child can bring out the vitamins and nutrients your child needs to grow properly.', 'Ensure that your child continues to eat these foods in appropriate amounts and keep in mind that both green and yellow vegetables, with the exception of broccoli, cabbage, and eggplant, should be avoided. Green vegetables have a moderate amount of folate, which should be monitored depending on age and gender.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}