{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"719a5673-5937-5e1a-b6c6-ccc6d7bbd04f","task_key":"default--validation--17801","task_revision_id":"1","upstream_id":"17801","short_description":"HellaSwag validation 17801","config":"default","split":"validation","body":"{\"activity_label\":\"Holidays and Traditions\",\"ctx\":\"[header] How to buy get well gifts [title] Research local and online floral shops. [step] Floral arrangements are a classic get well gift and enhance energy and decrease depression. They can be found at the hospital, supermarket, flower store, flower markets, or online flower stores, like ftd and even amazon.com.\",\"endings\":\"['[substeps] Also, at first glance, there is no standard set of flower arrangements. In 2010, the david foster boys made a pattern of clusters of flowers arranged in rows at flower shops.', 'Decide which company you would like to buy the arrangement from. [substeps] By purchasing flowers online, the flowers come directly from the grower and are usually freshly arranged so you do not have to worry about wilting.', 'You should also shop at specialty stores like target, starbucks, and walmart. [title] Search for a bouquet in a florist.', 'Search online to browse expert, local designs from independent floral and shopping blogs. [substeps] You could shop at local hobby stores or antique stores.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}