{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6acb3c03-d38c-5ec4-a6d4-3156bf01d5b9","task_key":"default--validation--35787","task_revision_id":"1","upstream_id":"35787","short_description":"HellaSwag validation 35787","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to fake longer eyelashes [title] Curl your lashes. [step] Before coating your lashes with mascara, use an eyelash curler to give your fringe the perfect curve. In addition to curling the base of the lashes, use the tool to curl the middle and tips of your lashes too.\",\"endings\":\"[\\\"Your lashes should look most lifelike when they're curled. [substeps] Cover any one eye with clear mascara, then cover the other with false lashes.\\\", \\\"[substeps] This helps the wings and detailing to look flawless while also bringing the illusion of more of a curl. Additionally, you'll also make sure to curl your lashes off to the side that will most likely get highlighted, while still providing air circulation for your desired effect.\\\", '[substeps] Look down as you place the curler at the base of your lashes. Clamp down on your lashes and hold for 8 seconds.', 'Your layers should be bouncy and curl beautifully on both sides. [title] Slide your sparkly mascara wand under the lashes.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}