{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5331dea2-2d41-5f2c-90b4-a5d5a870de9e","task_key":"default--validation--21582","task_revision_id":"1","upstream_id":"21582","short_description":"HellaSwag validation 21582","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to match a tie [title] Match the tie length according to your height. [step] Having the wrong size necktie will draw it undue attention, creating imbalance between your tie and outfit. The ideal length for a necktie should hang at about the middle of your belt.\",\"endings\":\"[\\\"This will be tall enough to drape on your belt when in doubt. [substeps] For loose neckties, which sit across the garment, it's recommended that they be 3-4 inches in length.\\\", 'Taller individuals will likely need a longer tie, while shorter individuals may need a smaller one. To test your tie length, you should : [substeps] Hang the tie around your neck.', 'If you have an average height, the entire length should be at or above a waist ball. If you have a high height, the necktie should have at least a fourth of the same length, making the wide area for the tie appear more open.', \\\"Square neckties are about as long as one's shoulder line. Large neckties tend to be tighter around the neck, often falling out slightly but also gripping the lapels or cuffs.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}