{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b9f0f9b2-9f03-5183-a71a-1acbbd04c322","task_key":"default--validation--48439","task_revision_id":"1","upstream_id":"48439","short_description":"HellaSwag validation 48439","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to get good looking hair (milk conditioning ) [title] Decide which products you'd like to use for your conditioner. [step] Milk conditioning can be used with just milk, but you can also use other items in your pantry for a natural hair mask to get beautiful, shiny hair. [substeps] For regular milk conditioning, whole milk works best.\",\"endings\":\"['You can use lowfat milk for fine hair, and cream for very coarse hair. Put it in a small spray bottle and spray over your hair, waiting 30 minutes before washing it out with shampoo.', 'It helps the hair stand up, with no lumps, and helps the hair hair bind together better. Some excellent choices are honey, soy milk, and honey oil.', 'Substitute , 1:2% and okay quality milk has 3 %. Any extra cream, milk substitute, and different oils can work well too.', 'Whole milk is the nastiest-you can get unlimited (which means one cup per banana and six bottles of milk makes for a total smoothie). It also lowers your cholesterol and leads to less fat.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}