{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3c1d859f-4303-51ca-97c1-6d49f908fe27","task_key":"default--validation--6983","task_revision_id":"1","upstream_id":"6983","short_description":"HellaSwag validation 6983","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to dress when you are short [title] Try the petite section. [step] If you are short, you might find standard cuts of clothing do not fit you as well as they should. Try shopping in the petite section of your favorite online or brick and mortar store.\",\"endings\":\"['[substeps] This section will cut the length of clothing you wear if you only wear a bit of top length. For example, you might wear a dress that shows off your hips, a sheath dress which shows off your shoulders, or a low rise style that shows off your back.', 'Seek out stores and brands that specialize in clothing for shorter men and women. These cuts will likely fit you better than clothing manufactured for people who are not short.', 'You could find clothing from an unusual range of occasions and life styles. [title] Go with knee-high if your body is more oval.', 'Do your best to get some clothing that is one size smaller than you. Try this well-fitting outfit : [substeps] A small, black maxi dress: this looks fantastic with skirts or dresses and is versatile for both men and women.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}