{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9f6d5694-c2c7-53f5-bf22-1b49d10bec24","task_key":"default--validation--14750","task_revision_id":"1","upstream_id":"14750","short_description":"HellaSwag validation 14750","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to look wonderful while being plus sized [title] Start your outfit by laying a solid foundation of proper-fitting undergarments. [substeps] Well fitting bras and panties are a must to avoid awkward lumps and bumps under clothing. Take the time to get measured at a specialty store to get under garments tailored to your shape.\",\"endings\":\"['Some look great on girls with sizes 31 and 45. Mix and match the body color, the shape and balance for a bedhead look.', \\\"[title] Since there's little need to buy the right corset for your shape, go with what fits your body best. [substeps] Preferably trousers, especially those that don't look low on your body.\\\", 'Try shape-wear for under skirts, dresses, and blouses to smooth your stomach and thighs. Many offer variations of camisoles and shorts to fit your needs.', 'It may be wise to avoid loud prints at the expense of some loose, colorful undergarments. Measure the top and bottom half of your body from your waist down to your hips.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}