{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5b96a451-0f63-5f79-b26b-408b7d9c67af","task_key":"default--validation--40787--variant-dc78e81c96a2","task_revision_id":"1","upstream_id":"40787--variant-dc78e81c96a2","short_description":"HellaSwag validation 40787","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to pintuck jeans [title] Cuff the bottom of each leg to your ideal length. [step] Roll up the cuff of each pant leg to adjust the cuff length. This will also give you an idea of what the cuff will look like when the rolled-up part is removed.\",\"endings\":\"['[substeps] Cuff the bottom of each pant leg at 45-degrees. This will be the spot where you will cuff your jeans, according to the length guidelines for your version of skinny jeans.', \\\"[substeps] You can cuff all the legs of your jeans without unraveling the cuff inch or two. Rolling down your pant leg means you'll have to work on reducing the length of the cuff [title] Fold the pant leg in half at the hip.\\\", \\\"Go slowly-there's no need to rush the process. Most shops will give you a rule of thumb when it comes to fitted jeans.\\\", 'Use a piece of white chalk to mark the bottom of the trench formed by rolled fabric. [substeps] You may want to put these pants on and check out the length in a mirror.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}