{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"97be5437-5ae7-5e39-83f1-99991a86f3be","task_key":"default--validation--49648","task_revision_id":"1","upstream_id":"49648","short_description":"HellaSwag validation 49648","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to clean hairbrushes and combs [title] Remove hair from the brush with your fingers. [step] Get as much hair out of the brush or comb first by simply picking it out with your fingers. Hair should come out fairly easily, so try to be as thorough as possible.\",\"endings\":\"[\\\"[substeps] If hair does come out as you use it, you'll need to repeat the same process several times to eliminate hard to reach strands. Take hairbrushes, combs, and brushes out once you've removed your hair from the brush or comb.\\\", \\\"[substeps] If you have any leftover hair lying around, place a sticky towel under your brush to catch any other hair that falls out as you comb. Toss out hair you weren't brushing on a paper towel to be tied later.\\\", \\\"If you encounter any hair that's stuck on, use a toothpick to loosen it and then remove it with your fingers. [title] Mix a mild cleaner with warm water.\\\", \\\"Pay special attention to hairs that you can't reach easily with your fingers alone. [title] Dry with a clean towel when you're done brushing.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}