{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"133e05b6-4811-5e50-b40a-93d96c7d5e27","task_key":"default--validation--44988","task_revision_id":"1","upstream_id":"44988","short_description":"HellaSwag validation 44988","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to fade a beard [title] Trim your beard to your desired length. [step] To start, simply do a routine trimming. Take your shears and trim your beard like you normally would, snipping the ends so the beard is the rough length you want.\",\"endings\":\"['As you trim, keep the comb away from the bone where it is most likely to break during this process. [substeps] The vital defect, of course, is line trimming.', \\\"[title] Set your trimmer to a lower setting and trim the bottom beard. [step] You should target your beard just below the adam's apple first.\\\", \\\"Avoid trimming the entire length of your beard. If it's too short to be trimmed, cut out the part you want to fade.\\\", \\\"When you're trimming, have someone hold the beard over a bottle of water. Slowly squeeze the water into the dry beard so it falls evenly.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}