{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"900b5ed1-f664-5537-bc2f-593321e08f46","task_key":"default--validation--12394","task_revision_id":"1","upstream_id":"12394","short_description":"HellaSwag validation 12394","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to reduce the appearance of scars from your face [title] Use sunscreen. [step] Protection from uv rays is essential for wound healing and scar care. No matter what approach you take, sunscreen should be part of your routine.\",\"endings\":\"['[substeps] Choose a full spf 6 sunscreen (or a sun protection spf 30) every day. The uv rays will have the same effect.', 'Natural uv rays are too harmful on the skin to be applied upon an scar. Optimal options include : [substeps] A broad spectrum sunscreen containing at least spf 30 or above.', '[substeps] Make sure you apply sunscreen whenever you go into the sun, even indoors. The uv rays from the sun can damage scar tissue and scalp, causing permanent damage.', 'Choose a sunscreen that is spf 30 or higher, and wear a hat on sunny days. Proper sun protection can also reduce the risk of hyperpigmentation of scars.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}