{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"083e84c3-8754-58ee-ab2c-924a8b0557df","task_key":"default--validation--50074","task_revision_id":"1","upstream_id":"50074","short_description":"HellaSwag validation 50074","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to sanitize your mascara [title] Apply rubbing alcohol (70 %) to a sheet of paper towel (also known as kitchen roll). [step] The fibers of the paper towel are strong even when saturated and will withstand being swiped with the mascara wand/spoolie. .\",\"endings\":\"['[substeps] Tissues are not suitable to use for this method, as, once saturated, the tissue will tear and the loose fibres will cling to the mascara wand/spoolie. Standard rubbing alcohol solution should be 70% alcohol (isopropanol) by volume.', 'Dip your swab into it to get the excess alcohol off and clean your lashes before applying the mascara. [substeps] The rubbing alcohol will allow you to prep better for this dip.', '[title] Use a toothpick with a slightly opened end. [step] If the tip is already wet, fill up your reservoir with distilled water (go at least two thirds full) to dilute it.', '[title] Submerge in a bowl of water for 10 to 30 minutes. [step] Remove from the water, dab up the excess water with the pad and gently massage on where is causing the mistake of smearing the mascara, as clearly you are trying to protect the lashes from infection.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}