{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5b9fffd4-fd2f-5355-8acf-7ba17cd89cb9","task_key":"default--validation--12694","task_revision_id":"1","upstream_id":"12694","short_description":"HellaSwag validation 12694","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to get pale skin [title] Avoid uv exposure. [step] People who live closer to the equator are exposed to more ultra-violet (uv) radiation, so their cells produce more melanin. This excess melanin leads to a darker skin pigmentation that helps the skin protect itself from uv damage.\",\"endings\":\"[\\\"The combination of uva and uvb radiation increases the number of harsh shadows on the skin over time that are often mined by the sun's uv rays. [substeps] Naked naked people are at a higher risk for melanoma.\\\", 'Limit what you eat and any recent exposure to these ultraviolet rays. [title] Know that you can still become pale.', \\\"Keeping out of the sun will keep skin from producing extra melanin, which may help the pigment return to a paler state. If your skin is naturally dark, however, staying out of the sun won't do much.\\\", '[substeps] Seasonal changes in the sun can also cause tonsils to deepen, resulting in grey, scaly growths on your skin. Your complexion may also darken as the sun goes deeper into the inner planets.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}