{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c42e40e7-f79f-545f-8f8a-8ce8aa534ed1","task_key":"default--validation--45642--variant-8ed4428ac43c","task_revision_id":"1","upstream_id":"45642--variant-8ed4428ac43c","short_description":"HellaSwag validation 45642","config":"default","split":"validation","body":"{\"activity_label\":\"Food and Entertaining\",\"ctx\":\"[header] How to diagnose heel spurs [title] Locate the pain. [step] Heel spurs can show up in multiple places on your heel. This can cause the pain to be slightly different depending on exactly where the heel spur is.\",\"endings\":\"['It can be hard to judge the strength of the spur and whether or not it is painful at all. When you just try to be more specific about where it is, your foot and heel will become increasingly entangled and there will be no wiggle room.', 'They can be located at the back of the heel or under the heel, near the sole of your foot. If you are experiencing pain along the back of your foot, up through your ankle, you might have a heel spur on the back of your heel.', 'The first position you identify is the thigh. You will see white or pinkish swelling and inflammation along the arch of the heel.', 'The most common places you might see the sensation of the pain are your heels and your nail. [substeps] You may discover that the pain is more acute in one heel then it is in another.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}