{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2d937805-088a-5b0f-9ef9-303ffbdc1c17","task_key":"default--validation--15067","task_revision_id":"1","upstream_id":"15067","short_description":"HellaSwag validation 15067","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to wear a backless dress [title] Try a low-back bra. [step] These bras have a band that wraps around your stomach, providing your chest with an ample amount of support. If you have a well-endowed bust, this is definitely the option you should consider first.\",\"endings\":\"['[title] Make yourself decent by using stick-on silicone gel petals. [step] If you have a small bust, you might be able to get away without wearing any support.', 'If you have a small bust, however, a low-back bra is a great option. The band sits over the section of the chest where your breasts sit, creating a soft, padded embrace.', 'Your chest should be evenly supported by the band. [substeps] Backless bras are good if you want you body to look larger.', 'If the current bra size does not cover your cle, or if you do not want to worry about your chest showing, try. [substeps] If you have an hourglass figure, low-back bra tends to fit best.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}