{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5d6b93c0-baa2-51ac-acfe-2ee6ef6f24b9","task_key":"default--validation--34641","task_revision_id":"1","upstream_id":"34641","short_description":"HellaSwag validation 34641","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to clean a bristled hairbrush [title] Use your fingers if your hairbrush has a light layer of collected hair. [step] Your fingertips are your most accessible and cost-effective tool. Start at the base of the cylinder or pad, grasp a clump of hair, and gently pry up and away.\",\"endings\":\"[\\\"It's important to take your time as hair strands break easily and will become difficult to remove. [title] Use a miniature hairbrush rake if your hairbrush has a substantial amount of collected hair.\\\", \\\"The bristles of the brush are the hardest part of the hairbrush and can be drawn away with your fingers, so use your fingertips to gently push the clump upwards so there's a more secure area. Repeat with each section of the brush you're looking for.\\\", '[substeps] Before you begin to clean your brush, you can usually see tension on the cylinder and pad. This is the oil, not the powder (\\\" free cream, \\\" which will save the bristles for later), helping your brushes to clean more efficiently.', 'This will ensure you use slow, controlled pull-offs and avoid cutting your hair while the brush is still attached to the pad. [substeps] Anytime your fingers catch on hair, pull the brush to get rid of the coil.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}