{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9b558877-7f39-5636-b083-d6dcff2f2f59","task_key":"default--validation--20632","task_revision_id":"1","upstream_id":"20632","short_description":"HellaSwag validation 20632","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to apply gel nails [title] File and shape your nails. [step] To get the ultimate look from your at-home gel nails, start with the ultimate blank nail. Take the time to cut, file, and shape your nails.\",\"endings\":\"[\\\"This will allow you to add texture to your nails. Try to avoid rough edges, and don't file too hard.\\\", '[substeps] Because your fingernails will be short and thin, you want to make sure to file the shape evenly. [title] Use your fingers to shape your nails.', 'Before you cut them, decide what shape you want. Cut the basic shape and then file the tips.', \\\"Try on your over the counter gel polish remover before applying it to your nails. While this doesn't actually dissolve the gel, it will make the process of trimming and filing easier.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}