{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"891dfc00-10d6-59c0-8b63-74ebdb55febb","task_key":"default--validation--3303","task_revision_id":"1","upstream_id":"3303","short_description":"HellaSwag validation 3303","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to reduce aging effects [title] Wear sunscreen daily. [step] Uv rays from the sun are extremely damaging to the skin, and regular or excessive exposure can make you appear older than you are. The sun's rays cause age spots, wrinkles, and a blotchy, uneven complexion.\",\"endings\":\"['Opt for sunscreen that : [substeps] Penetrates to the pores or will not disintegrate the caked on makeup causes dark circles and are soothing stay away from tanning beds [title] Apply sunscreen to affected areas. [step] Products with spf 15 or higher help deage old or damaged skin.', '[substeps] Too much exposure to sunlight can cause skin cancer, so you should have a dermatologist check your skin periodically for anything that might be a problem. The dark tan look has largely gone out of fashion among younger generations, so there is really no need to chase that \\\" summer tan \\\" look anymore.', 'Limit your exposure to the sun by spf at least a day a week. [substeps] Use sunscreen in order to protect your skin from the sun, and get a sun-exposure barrier from the sun.', '[substeps] Avoid exposing sunscreens that are harmful to your skin, such as your face soap, cosmetics, or acne creams. Always use sunscreen with an spf.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}