{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c1bda779-c85b-50dc-b707-dadf3a1ac263","task_key":"default--validation--13249","task_revision_id":"1","upstream_id":"13249","short_description":"HellaSwag validation 13249","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to buy a wedding band for men [title] Find a ring suitable for his lifestyle. [step] Your fiancé is going to wear this ring every day, so choose one that will mesh with his daily routine. A guy who works a lot with his hands, for example, would appreciate a slim ring with round edges so he can easily take it on and off.\",\"endings\":\"[\\\"[substeps] Check the band's design to see what kind of engraving is common. A good ring will have: heart attached, flowers (or gems), bow symbols or letters, etc.\\\", '[substeps] Men with active lifestyles might prefer a platinum ring, which is especially heavy-duty and not easily scratched. \\\" comfort fit \\\" wedding rings are especially recommended for men because they are easily slipped on over larger knuckles.', \\\"[substeps] You can buy rings in black, silver, or pink. Remember that black rings are a lot more expensive than pink ones; you can also choose a ring that's closer to pink, as your fiancé would appreciate it more if it were pink.\\\", \\\"A girl who works a lot with her hands, for example, would definitely get a diamond engagement ring with round edges when she gets married. [title] Consider the person's other interests.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}