{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"35d67bf1-0e7e-5d04-9e5b-31d8f5fb86f6","task_key":"default--validation--34122","task_revision_id":"1","upstream_id":"34122","short_description":"HellaSwag validation 34122","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to heal dry cracked hands [title] Apply olive or coconut oil to your hands. [step] Olive and coconut oil are great natural moisturizers. They can also help to heal any cracks or cuts in your hands due to dryness.\",\"endings\":\"['Apply a generous amount of olive or coconut oil to your hands. Then, rub in the oil well and let it dry.', 'Apply olive oil gently to your dry hands and leave it on for a few minutes before rinsing off with warm water. [substeps] You may also consider squeezing an extra drop of olive oil into a glass jar in your kitchen for an added aroma.', 'Apply the oil several times daily or as needed. [substeps] You can apply the oil in the morning and three times a night before bed to see what results.', \\\"You can substitute jojoba oil for the olive oil if you don't want to wait for the oil to degrade. You can also massage your hands over a clean, dry cloth to test its effectiveness.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}