{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c7498aee-52ea-50ba-a642-987aa0ffd410","task_key":"default--validation--43752","task_revision_id":"1","upstream_id":"43752","short_description":"HellaSwag validation 43752","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to use a foam roller on your legs [title] Lie with the foam roller under your thighs. [step] Put the foam roller under your body and lie face down, using your forearms to support your body. Elevate your body so that your back is straight and lift your toes off the floor.\",\"endings\":\"[\\\"Your back should be flat and your hips should be supported. [substeps] Get comfortable with whatever position you're at, and relax.\\\", 'You should now be face down with your forearms on the floor and the foam roller should be 2-3 inches (5.08-7.62 cm) above your knees. [title] Push backwards to roll towards your hip muscles.', 'Place your arms straight out in front of you. Pull your shoulders down by lifting your arms off the floor.', 'Holding the foam roller over your shoulder, slowly place it on your lower abdominal area, between your thigh and butt. Move the roller down your back until you reach your thigh.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}