{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e60c83bf-d286-50ff-b6f8-9decdb169d0b","task_key":"default--validation--41849","task_revision_id":"1","upstream_id":"41849","short_description":"HellaSwag validation 41849","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to choose a tampon size [title] Learn about absorbency options. [step] Tampon sizes correspond the amount of liquid they can absorb. You can select the right absorbency level for you based on the level of your flow.\",\"endings\":\"['The absorbency level (ac) is expressed as the flow of liquid. The ac is the amount of liquid your vagina submerse into, while ac is the amount of gas your body likes to use in terms of actually giving you gas.', \\\"Absorbency is one of the most important factors when you're choosing a tampon. [substeps] Absorbency is the amount of fluids your body uses per minute.\\\", 'The most common tampon absorbency levels (moving from smallest to largest) include : [substeps] Regular super super plus some brands may also offer junior/slim (smaller than regular) and/or ultra (larger than super plus). [title] Choose the lowest level of absorbency needed to avoid tss.', 'The absorbency rating will also depend on your specific condition. [substeps] Keep in mind that absorbency is not due to gender, gender, age, or reduce weight.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}