{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c095292b-c34b-5864-a20b-258f394ce968","task_key":"default--validation--2389","task_revision_id":"1","upstream_id":"2389","short_description":"HellaSwag validation 2389","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to do a dutch mohawk braid [title] Skip the shampoo. [step] When you're trying out a new hairstyle, it can be tempting to wash your hair first so that you're starting with a squeaky clean canvas. However, freshly washed hair can actually be more difficult to work with because it's silky and slippery.\",\"endings\":\"['Try creating the dutch mohawk braid on second or third day hair. The natural oils will make the hair easier to handle.', 'To avoid this, skip this step and wash your hair as you normally would. [title] Saturate your hair with the water, preferably a lightweight shampoo.', \\\"Get your hair trimmed and conditioned so that you're no longer swayed in the process. Split up your layers of hair and braid them into a single braid, making sure that your hair is still a straight and smooth condition.\\\", \\\"Instead, avoid running a comb over your hair after applying shampoo. Go slowly and don't overdo it.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}