{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3624130f-6e08-56ca-b986-95d41ba522a8","task_key":"default--validation--31640","task_revision_id":"1","upstream_id":"31640","short_description":"HellaSwag validation 31640","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to decide if you should retire to a warmer climate [title] Evaluate the possibilities for work. [step] Just because you're retired doesn't mean you might not want to engage in some part-time work. For instance, you might want to parlay your lifelong love of art into a gig at your local framing shop.\",\"endings\":\"[\\\"But even if you're just looking to stay with a local business for a while, you could probably take part in a more laid back lifestyle at home. [substeps] Obviously, many mistake this approach as a waste of time, and keep thinking that it doesn't require work.\\\", \\\"Maybe you're an avid hiker and want to start traveling abroad. If that comes across as not exciting to you, a traditional retirement plan might not be the most healthy option for you.\\\", \\\"Many trade associations now allow current working colleagues to return to the field to gain valuable experience, in which case you may find it more interesting and rewarding. This isn't to say that you should only retire when you have something of value to contribute to a new field.\\\", \\\"If staying busy is a priority for you even in retirement, evaluate opportunities for part-time work during your brief vacation visits. [substeps] You could also evaluate the possibilities for work by searching for part-time jobs in the warm-climate location you're thinking of retiring to by searching online.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}