{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2a7beac2-0168-5660-8d36-2d445145d13b","task_key":"default--validation--25930","task_revision_id":"1","upstream_id":"25930","short_description":"HellaSwag validation 25930","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to dry nail polish quickly [title] Paint your nail polish in light, thin layers so each layer can dry. [step] Wipe off a bit of polish from your applicator brush, and apply 2-3 thin, light layers. Let your polish dry for about 1-3 minutes in between each coat.\",\"endings\":\"['Nail polish will not dry completely if applied in multiple heavy layers. [substeps] This may take longer to apply the polish overall, but the drying time will be significantly less.', 'It should take a few light coats, but a lot will dry out fast. [substeps] Drop some sharpie to outline your nail polish to give it a finish.', \\\"[substeps] The more layers you apply, the faster your polish will dry. Don't be impatient when you apply the polish! If you wait several more minutes or so, your polish will dry.\\\", '[substeps] Give your polish a shake on a large blow dryer to speed up the drying process. [title] Use nail polishes only on heavily painted nails.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}