{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"1bb67256-99f1-5741-bf77-1b2fed69f821","task_key":"default--validation--3332","task_revision_id":"1","upstream_id":"3332","short_description":"HellaSwag validation 3332","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to clean hairbrushes [title] Remove the hair from the brush. [step] Taking out the old hair is always a good idea, since dirt and skin particles tend to stick to it as it builds up in your brush. Reach in and pinch the hair with your fingers, then pull it out from around the bristles.\",\"endings\":\"['[substeps] Brushes that are attached to anything (such as the brush) will be clean and free of dirt and bacteria, but brushes with metal can damage them and produce residue. [title] Choose one that is easy to clean.', '[substeps] These small pinches are usually easy to remove or you can simply take them out. Removing used hair from an old hairbrush, just may take some effort to get it off of the handle.', \\\"Keep doing this until you've extracted all of the hair from the brush, then throw the hair away. [substeps] If your brush's bristles are made from natural fibers, take care not to yank them out with the hair.\\\", '[substeps] Most brushes have a teeth crown screw or other attachment. If not, put the brush in to remove the crown.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}