{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2a9c6623-671c-50fa-a73a-14b3c29ac0e8","task_key":"default--validation--34766","task_revision_id":"1","upstream_id":"34766","short_description":"HellaSwag validation 34766","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to get the smell of a perm out of your hair [title] Rinse your hair before applying a neutralizer. [step] Ask your hairstylist to thoroughly rinse your hair for 5 minutes. Your stylist will most likely use a clarifying shampoo to help remove any silicone or chemical buildup prior to adding the neutralizer.\",\"endings\":\"['However, you may have the option of adding a clarifying oil after a shower to clear away any sebum after a shower. You can also use a clarifying lotion or serum instead of these products for a perkier effect.', '[substeps] If you have light brown or light blonde hair, skip this step. If your hair is already fairly platinum blonde, you do not need to worry about messing with this.', 'This will help ensure that your hair is properly cleaned before the chemicals are applied, which may eliminate some of the chemical smell left in your hair by the perm process. [title] Wash your hair with a clarifying shampoo at home.', '[substeps] Urine smelly perm hair is quite hard to remove with a pumice stone or a ton of water, so opt for a clarifying shampoo instead. Hot water flushes out all the minerals and other things that you need.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}