{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"982ac07a-ab9a-5830-ab6c-4307883f992a","task_key":"default--validation--10349","task_revision_id":"1","upstream_id":"10349","short_description":"HellaSwag validation 10349","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to find the perfect bridesmaid dresses [title] The internet is a wonderful resource for finding bridesmaid dresses. [step] We also recommend thumbing through the more popular wedding magazines, such as bride's and modern bride magazines. It is recommended that the bride go shopping with one or two of her bridesmaids and see what styles they like.\",\"endings\":\"['Once you narrow it down, you can then get input from your other bridesmaids if you desire. [title] What are the latest trends in bridesmaid dresses? [title] Styles-a-line dresses which look great on all different body shapes and sizes are very popular.', 'Unfortunately you cannot shop as often as you would if you were looking for a matched bridesmaid. [title] When choosing your bride pick three different style styles : [step] Cut length, cut thickness and from most \\\" pre-shoot \\\" styles to the basics.', 'While every bride is different, everyone is both different and has different tastes. [title] See if the bride has a favorite look for her wedding dress.', '[title] Begin your search by searching for ideas or general opinions on particular wedding dresses. [step] Try to not get too rigid and only search for a few dresses that you think may work well together.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}