{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9bae02ff-ff05-552a-b08a-438d3f45af71","task_key":"default--validation--46901","task_revision_id":"1","upstream_id":"46901","short_description":"HellaSwag validation 46901","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to prevent skin darkening in the sun [title] Wear sunscreens and sun blocks. [step] Lotions, creams, and blocks that protect from the sun work in different ways, but they are all designed to protect your skin from damage, and this will prevent your skin from getting dark in the sun. [substeps] Sunscreen filters the uv radiation that passes through to your skin.\",\"endings\":\"['They allow the sun to penetrate your skin through the molecules generated in your skin. In turn, the uv rays reflect off your skin and soften it.', 'Look for a sunscreen without fragrances or whiteners, which tend to have harder absorption and damage your skin. Hydrate from the sun every day before you go outside.', 'Your skin can absorb more uv radiation, causing further darkening. Try to use sunscreen that spf 30 or higher, just to be absolutely sure.', 'Look for a broad-spectrum sunscreen, which protects from uva and uvb, with an spf of at least 30. Sunscreen gels are good for hairy parts of your body, like your scalp.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}