{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e537ffc1-f80d-51a0-9e64-6c7a2f56ec38","task_key":"default--validation--15953","task_revision_id":"1","upstream_id":"15953","short_description":"HellaSwag validation 15953","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to buy sunglasses for toddlers [title] Purchase sunglasses that offer ultraviolet (uv) ray protection. [step] Uv ray exposure is responsible for nearly all skin cancers, and also has negative effects on the lens and inner structure of your child's eyes. Any sunglasses your toddler wears should offer protection against both types of uv rays: uva and uvb.\",\"endings\":\"['[substeps] If your toddler is younger, make sure the sunglasses they wear offer ultraviolet protection for and prevent uvb rays from penetrating the eyes. Make sure the frames are biodegradable and are uva-resistant.', 'Only purchase sunglasses that have a clear label on the frame or lens stating that they protect against uv rays. Look for glasses that block 99-100% of these harmful rays.', \\\"[title] Purchase glasses from your child's specialist. [step] Before you buy a pair of contact lenses for your toddler, your specialist will likely select the one they would like for your child (s) and recommend the correct lens size for your child.\\\", '[substeps] If you need protection, go for sunglasses with a uva-uvb spectrum. Tap your finger against the outside of your wrist as you place the sunglasses on.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}