{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f9c823e1-0a96-540c-8d29-7708b6167851","task_key":"default--validation--31770","task_revision_id":"1","upstream_id":"31770","short_description":"HellaSwag validation 31770","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to wear jeans with sneakers [title] Go with slim fit jeans. [step] Slim fit jeans with a straight leg work best with high tops. Avoid super skinny jean styles and aim for a more tailored look.\",\"endings\":\"['When possible, fit skinny jeans with higher tops. Go for jeans that are no shorter than one foot to accentuate your figure.', '[substeps] Straight fit jeans are also better for cooler weather weather with a cooler skirt or leggings. Slim fit jeans tend to have tapered legs, whereas skinny fit jean styles suggest fatness for your legs.', 'Tank tops are also great for pairing with high tops, as their flattering form will draw attention away from your chest. [substeps] Go for loose fitting and strappy tops over baggy tight tops that wrinkle easily.', \\\"The jeans should provide a slim but comfortable fit. If you're having a tough time finding the right fit, getting your jeans tailored is always an option.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}