{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a1bc1e1c-cf7b-535d-a1c4-db3f55165aa8","task_key":"default--validation--9525","task_revision_id":"1","upstream_id":"9525","short_description":"HellaSwag validation 9525","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to get rid of dreadlocks [title] Cut off each dreadlock with scissors. [step] How short you cut the dreadlocks depends on how much hair you wish to retain. Perform this step even if you plan to shave your head, it will make the process a lot easier.\",\"endings\":\"['[title] Gather hair from your dreadlocks all over your head. [step] Do this up to the scalp, as these dreadlocks are usually a shade darker.', '[substeps] Keep the amount of cutting off to a minimum. One short dreadlock is enough to cover the entire head without cutting off too much hair.', '[substeps] If you plan to shave your head, cut the dreads off close to the scalp where the hair is less tangled. If you want to retain a bit of length without too much work, cut off lock 1-2 \\\" from the scalp.', 'Trim as much to the desired length as possible using barber scissors as they are too sharp for the most regulation. [title] Wash your head before getting the dreadlocks done.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}