{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3a21915d-7077-51a6-85f7-2d54f4f18f03","task_key":"default--validation--35928","task_revision_id":"1","upstream_id":"35928","short_description":"HellaSwag validation 35928","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to increase breast milk production [title] Consume a minimum of 1 , 800 calories a day and drink at least 6 glasses of fluids while you are lactating. [step] If you're currently dieting, it could be decreasing your milk production. Unsurprisingly, what you eat has a big impact on the quality and quantity of the milk produced.\",\"endings\":\"[\\\"Here are some general guidelines for you to remember about diet and breast milk : [substeps] Find excellent sources of calcium. These will help your little baby's little bones grow healthy and strong.\\\", \\\"[title] Eat 4 to 6 cups of milk per day. [step] If you're currently underweight, aim for 25 to 35 cups per day.\\\", 'A list of guidelines for how much you should consume might be printed on the back of your bottle. [substeps] For example, you may want to limit your milk (97 g) to about 2 glasses of water per day.', '[substeps] Women in the first month of pregnancy generally need between 80-400 calories a day. Men in the third month will eat within 15-30% of this extra calorie.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}