{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b4eb9e9f-d2bd-5b52-adef-1eea5a45516e","task_key":"default--validation--18899","task_revision_id":"1","upstream_id":"18899","short_description":"HellaSwag validation 18899","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to select a hair relaxer [title] Choose a no lye relaxer. [step] If you have a sensitive scalp, look into getting a no lye relaxer. These types of relaxers are known for being milder and are often used on sensitive scalp.\",\"endings\":\"['Choose a relaxer that helps relax and, a hair relaxer that has anti-aging properties. Many hair relaxers have elastin in them so they function just as well as hair relaxers and may result in less damaging effects.', '[substeps] Non-toxic hair relaxers (especially those without lye) can damage your hair if you use them against your scalp. You can find them at most health and beauty stores or in pharmacies.', 'You should not use such relaxers on more sensitive hair, as they will irritate your skin. [title] Consult the ingredients list for your hair relaxer.', 'These formulas work very quickly so it may be in your best interest to enlist the help of a friend or a professional when working with them. [substeps] No-lye relaxers are best for people who want to relax their own hair at home.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}