{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a574c414-bd8e-5b8c-a97f-a5f78abeb01c","task_key":"default--validation--19454","task_revision_id":"1","upstream_id":"19454","short_description":"HellaSwag validation 19454","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to tighten face skin [title] Do \\\" the lion face \\\" pose for at least one minute. [step] This exercise tightens and tones all the muscles in your face to help you look younger. [substeps] Close your eyes and inhale slowly while scrunching your facial features as tightly as possible.\",\"endings\":\"['Keep your face tilted upwards into a gentle arch and your belly rising up towards your shoulder. Hold the pose for five seconds and notice your skin loosening and getting firmer.', 'You will feel the elastic stretch in your face, pulling it inward. Release it once the elastic is no longer loose.', 'Exhale and stick out your tongue as far as it can go. Open your eyes wide and raise your eyebrows.', 'Keep your jaw flexed and your shoulders relaxed. Shift your weight slightly to the other side (heel) and lock your knee in place.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}