{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9a8e0499-c028-5a8e-a7ec-e53264b277f9","task_key":"default--validation--35241","task_revision_id":"1","upstream_id":"35241","short_description":"HellaSwag validation 35241","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to style hair with hot rollers [title] Get the rollers ready. [step] Go ahead and plug in the hot rollers so that they're fully heated by the time you're ready to put them in your hair. If this is your first time using your set of rollers, read the manufacturer's instructions to make sure you use the equipment properly.\",\"endings\":\"[\\\"[title] Spray your hair with gentle hold hairspray. [step] Start with dry hair, since your hair won't hold curls if you use this method with wet hair.\\\", '[substeps] Always hold the handle of the steam wand between your wrist and the rollers. Never hold the handle of a curling iron at a normal straight line.', '[substeps] Make sure your hair is fully washed and dry to avoid taking off any primer or styling gel. [title] Brush your hair while in the rollers.', '[substeps] For thicker hair, use an extension. If your hair is thick, use an extension with one end attached to the round back of your hair.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}