{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e483537a-f8b6-5bb9-bd50-36cda9270fca","task_key":"default--validation--13676","task_revision_id":"1","upstream_id":"13676","short_description":"HellaSwag validation 13676","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to treat a swollen knee [title] Compare your affected knee with your other knee. [step] Look for puffiness around the kneecap or around the sides of the knee. Comparing your two knees is a good way to check to see if there is swelling or redness and to see if is something wrong.\",\"endings\":\"[\\\"[substeps] There might also be swelling at the back of your knee. This could signal a baker's cyst, which is when extra fluid is pushed into tissue behind your knee.\\\", '[substeps] Look for tenderness that is accompanied by soft, tearing or ripping skin. You may see redness and swelling along the edges or along the seams.', '[substeps] Measure your affected knee and then compare it to your other knee. It is generally the same as comparing two knee surgeries but it is also slightly different.', \\\"Swelling-swelling is an odd, but clearly, very serious swelling, which you may have noticed either before or after surgery. Swelling in an inflamed knee usually occurs after surgery and won't require immediate medical attention.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}