{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8e487a7c-a539-523b-ad72-5b11fe9a4030","task_key":"default--validation--49832","task_revision_id":"1","upstream_id":"49832","short_description":"HellaSwag validation 49832","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to grow your hair super long [title] Brush your hair gently. [step] Use a brush with natural boar bristles. Brush your hair from the tips and move upward to de-tangle your dry hair.\",\"endings\":\"['Work out tangles slowly and never tear or pull at your hair when brushing. [substeps] If you have it on hand, apply some kind of hair protectant prior to brushing to minimize split ends.', \\\"Don't brush on the sides, where you're more likely to release water. Use the end of your brush to distribute the water throughout your hair.\\\", 'Wash your hair after the wash to prevent dandruff. [title] Use a blow dryer to dry your hair.', '[title] Blow dry your hair just above the affected area , 2-3 times a week. [step] Use small, pointed, fine-tooth combs.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}