{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8959c5ff-9738-5cee-a3ad-236d9385aef9","task_key":"default--validation--25702","task_revision_id":"1","upstream_id":"25702","short_description":"HellaSwag validation 25702","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to make boobs bigger naturally [title] Learn about your breasts first. [step] Breasts are made up of specialized milk-producing tissue separated into lobes, as well as fatty tissue that surrounds them. Blood vessels provide circulation to the breast.\",\"endings\":\"['Not only do these vessels provide blood, but they help the breast tissues to produce more milk. You will know your breasts having tissue in them when you hear popping, squealing, and bleeding.', 'If breast size is a concern for you, you may want to start slow. [substeps] Although some websites are not reputable, most of them are informative and rely on facts.', 'Connective tissue, made from a protein called collagen, helps hold them up. [title] Eat a diet with the right nutrients.', 'Breast tissue attaches to the smaller components of the testes, and is usually used to lubricate them and not interfere with the growth of the larger buds. Nipples look thick and bulgy when not used, and can be enlarged over a long period of time.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}