{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b3a48a52-3411-5b8f-aa75-fec253649c5f","task_key":"default--validation--24300","task_revision_id":"1","upstream_id":"24300","short_description":"HellaSwag validation 24300","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to get rid of tattoo scarring and blowouts [title] Add background shading to the tattoo. [step] Ask an experienced tattoo artist to add some additional shading to the tattoo in order to cover up the scarring or blowout. Typically, a blowout is visible on the outermost edge of a tattoo.\",\"endings\":\"['[substeps] Give the tattoo an outline before getting rid of the first layer of shading. Over time, your tattoo will become stronger and more defined.', 'To cover this up, you can expand on or add to the tattoo. Alternatively, you could add some background shading to cover the blowout.', \\\"The sharp edges of good shading will make your tattoo look more striking. [substeps] You can also add a second, finer shading to overlap the existing artist's shading.\\\", 'However, you may decide to add some other shading to cover up the tattoo. [substeps] Refine your tattoo if you decide you want to go the extra mile.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}