{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b9e6298a-e6ee-5dd3-a20f-dfc5dfed322d","task_key":"default--validation--17247","task_revision_id":"1","upstream_id":"17247","short_description":"HellaSwag validation 17247","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to tie a doo rag [title] Place the durag on your head. [step] You can choose a color and style of durag that work for you. Many people prefer doo rag that are a stretchy material that can be seen through when stretched.\",\"endings\":\"[\\\"They look like long cargo pants or long jacket pieces. Your crotches will have to be about even or slightly larger than the durag's elastic.\\\", \\\"This makes them more breathable when they're tied tightly around your head. [substeps] Line the center seam up with the center of your head for symmetry.\\\", 'The durag should be loose enough so that you can loosely wrap the rag around your head. [substeps] Your durag may be hard to place with one hand or with two hands so you need to make sure that it will allow you to handle it.', 'Use a product like dawww.dahoo.com or zieforednwearer if you want a casual cut. Durag fabric is also often called sewn cloth and is woven with hemp or microfiber.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}