{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"03c7cbc3-5203-54aa-9067-f5fce9d4229f","task_key":"default--validation--38308","task_revision_id":"1","upstream_id":"38308","short_description":"HellaSwag validation 38308","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to remove nail polish from acrylic nails without the nails coming off [title] Use a non-acetone based nail polish remover. [step] Since acetone may remove your acrylics, it is important to use a non-acetone nail polish remover. Many brands, such as cutex, make non-acetone nail polish removers.\",\"endings\":\"['Check the bottle to ensure that you are getting the right kind. [title] Apply nail polish remover to a cotton ball.', 'These products help rid nail polish from nail nails that are not acrylic. [substeps] Non-acetone nail polish removers help remove the base of your acrylic nails without damaging the surface.', 'These products work by dissolving nail polish from the surface of the nail. [substeps] Look for brands with an ingredient such as acetone or polico.', \\\"You will need to read the label to determine if this product contains acetone before applying it to your nails. Follow the owner's manual or to download the general product.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}