{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"58c4c4a2-cda1-5007-8b5e-a3c58a77c534","task_key":"default--validation--4909","task_revision_id":"1","upstream_id":"4909","short_description":"HellaSwag validation 4909","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to style short hair for girls [title] Gather small-sized sponge, plastic or hot rollers. [step] You may want to practice using them before it's time to style your hair. Looking into a mirror, try winding your hair around a curler and securing it with a hair pin.\",\"endings\":\"['If you have to wash your hair regularly, try using a lukewarm setting and a medium or high heat setting. If you are more patient and professional, invest in a spritz bottle with smoothing spray or use a terrycloth shampoo.', \\\"[title] Layer your hair into a ponytail and secure it with bobby pins. [step] It's usually a good idea to position your hair into a ponytail or a one-two braid so that your hair is ready to let loose.\\\", \\\"Some types of rollers slip out of short hair, so you'll want to experiment with securing them. [substeps] When you have short hair, you'll need more rollers, especially for tight curls.\\\", 'There are so many styles out there, you can try them all out and see which one works for you. [title] Use a curling wand or curling iron.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}