{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5d125cf9-6cc6-5b33-80b1-c827145692f2","task_key":"default--validation--38610","task_revision_id":"1","upstream_id":"38610","short_description":"HellaSwag validation 38610","config":"default","split":"validation","body":"{\"activity_label\":\"Computers and Electronics\",\"ctx\":\"[header] How to maintain the skeletal system [title] Consume foods and drinks high in calcium. [step] Adults should be getting 1 , 000 mg of calcium every day. Calcium is the most important mineral for maintaining bone health, because bones use calcium to remain strong and prevent bones from becoming brittle.\",\"endings\":\"['Men over 50 and women over 70 need more calcium-1 , 200 mg per day. [substeps] Foods high in calcium include dairy products, broccoli, salmon, leafy green vegetables, soy products, and cheese.', 'Your daily intake should be 150 mg of calcium for every 30 pounds you want to lose. [substeps] Not all calcium is used in eating.', '[substeps] Get enough calcium by eating a diet of fish. Walnuts, broccoli, blueberries, halibut, lentils, apples, pears, grapes, kiwi, and figs are all great sources of calcium.', '[substeps] You can try eating foods rich in calcium like fruit, vegetables, nuts, and beans. These foods make up about 2 , 500 mg of calcium per kilogram of body weight.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}