{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"45496a86-78b9-5b90-b047-f22a769a6646","task_key":"default--validation--43842","task_revision_id":"1","upstream_id":"43842","short_description":"HellaSwag validation 43842","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to give a leg massage [title] Learn about basic anatomy. [step] It's helpful to know some anatomy before you give a massage. Thigh muscles are in 4 basic groups which run from the hips down to the knee, in the front, sides, and backs of the legs.\",\"endings\":\"['Knowing where the bones are located should also be helpful because the tissues that connect muscle to bone are important to massage. [substeps] The connective tissues around the joints, like the hips, the knees, the ankles and the feet, can be pulled, kneaded, or compressed.', 'The hip muscle is the center of the body and the thigh muscle is the opposite of that. These muscles are located all over the body at 90 degree angles from each other.', 'These groups provide support to parts of the leg, that must be kept separated from the rest of the body. [substeps] To identify which group of muscles to give massage, look over your body.', '[substeps] Loin flexors: these muscles are located on either side of the lower thighs between the thigh and buttocks. Calf muscles: calf flexors: these muscles are located on the soles of the feet at the front of the arches of the feet to provide stability.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}