{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"326b6991-9977-5621-942f-4bbd9eaefc94","task_key":"default--validation--42600","task_revision_id":"1","upstream_id":"42600","short_description":"HellaSwag validation 42600","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to clean road rash [title] Look at the depth of the wound. [step] When you get road rash, you first need to decide how deep the wound goes. If you had a small fall, the road rash will likely be shallow and only affect the upper layer of skin.\",\"endings\":\"['If you had a bad fall, your road rash may be more severe, extending into deeper muscle and bone tissue. Look at your wound and see how deep the scrapes go.', 'If the wound has a significant depth, it can affect the tone of your skin when it is fresh. [substeps] You will know if you are pregnant by looking at your clothing for the depth of the wound.', 'However, if you hit a larger animal, the wound may be deeper. You may also see physical marks on the wound, like cuts, scrapes, or bruises.', \\\"It won't hurt your skin, and in extreme cases you might want to treat it at home. [substeps] The shallower the wound, the less likely it is to cause infection.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}