{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"690d1f3a-e748-5a11-be1d-babddc32af5a","task_key":"default--validation--8621","task_revision_id":"1","upstream_id":"8621","short_description":"HellaSwag validation 8621","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to trick people into thinking you're thin [title] Be measured for a bra. [step] Having the right-sized bra is important because it helps support your breasts properly. If your breasts sag, it can make you look older and heavier.\",\"endings\":\"[\\\"To pull these away from your chest, you will have to go large or super large (50-52). If you don't go large, those little cups that you find bulging out will do the trick.\\\", 'Cups should not wrinkle (too large) or bulge your breasts out the tops or sides (too small). Instead, your breasts should fill them out nicely.', 'Ladies should always have a bra that is a size smaller than 1/2 cup. [substeps] Many bra stores lack the opportunity to measure you for a bra as they are taking measurements for everyday wear.', 'Head to the store, ask a sales associate, or have a friend measure you for a bra. Even if you are older and overweight, exercise daily to help lift these weights.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}