{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"92798b55-ed5d-5960-b14b-8a7392641ad0","task_key":"default--validation--27725","task_revision_id":"1","upstream_id":"27725","short_description":"HellaSwag validation 27725","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to scrunch your hair overnight [title] Scrunch your hair. [step] The method of scrunching your hair is similar to crumpling up a piece of paper. Pick up individual sections of hair, squeeze the strands between your fingers, and crumple the ends of the strand up toward your roots.\",\"endings\":\"[\\\"[substeps] Don't squish the strands together. Scrunching against your scalp, however, will hurt your hair's elasticity.\\\", \\\"It will seem natural and loose if you just scrunch from the roots. [title] Wrap a baby's head scrunchie around your hair from mid-back.\\\", 'This crunching method will create curls, bends, and volume in your hair. Use this method when applying your styling products.', 'Split the strand down the middle, blow dry, and scrunch your hair 1 hour before bed. [substeps] Make sure you put on any sealants you used earlier in the day.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}