{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"786bcc65-fea4-57e5-b7a6-8dc99a9bce68","task_key":"default--validation--40119","task_revision_id":"1","upstream_id":"40119","short_description":"HellaSwag validation 40119","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to buy a strapless bra [title] Get a measuring tape. [step] A measuring tape is necessary in order to accurately measure your bust size. The flexibility of the measuring tape will allow you to measure the circumference of your bust.\",\"endings\":\"['Scoop your waist and cup it with either your hands or a measuring tape. Then, measure the width of your fullest part, i.e., your bust.', 'It will also allow you to easily make adjustments to your bra, such as buying an artificial hemline or not purchasing one at all. [substeps] Measure your shoulders, chest, stomach, and back, including between your collarbones.', \\\"Before purchasing a strapless bra, you can carefully measure out where the front of your bra will be. [substeps] Find a bra that's comfortable.\\\", '[substeps] You can go to your local pharmacy, like walgreens or cvs, or a fabric store to find a measuring tape. You can also try visiting a target or a walmart; both stores have sewing sections.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}