{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4533c0d0-a069-506d-abf5-c9f6e341c65b","task_key":"default--validation--20184","task_revision_id":"1","upstream_id":"20184","short_description":"HellaSwag validation 20184","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to get gum out of your hair [title] Use smooth peanut butter. [step] Peanut butter is a classic solution, and most people swear by it. It works so effectively because its oil content lubricates the hair, while the natural qualities of the peanuts break down the gum.\",\"endings\":\"['[substeps] If you have fine, dry hair, peanut butter is probably the best option. If you have very dry hair, however, its time to seek a more natural method.', '[substeps] You usually want 80 grams of fat per 100 grams of peanut butter. [title] Use a rubber band to separate the affected hair.', \\\"That said, it can effectively remove gum from your hair, regardless of how careful you were trying to be with the cleanliness of your hair. [substeps] Don't forget about the pros: peanut butter is more oil than water, yet it is still pretty cheap, but you may not be able to afford to purchase it.\\\", \\\"Smooth peanut butter is sweeter than other oils and it also has less flakiness, so it won't flake easily when washing, curling, or brushing your hair. [substeps] If you'd like to have a more natural mixture of peanut butter and honey, see the section on brushing and conditioning.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}