{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"db1a708a-77a7-52fa-a5f3-ec7df916e1f0","task_key":"default--validation--15923--variant-5b0e917fef66","task_revision_id":"1","upstream_id":"15923--variant-5b0e917fef66","short_description":"HellaSwag validation 15923","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to wash a hair weave [title] Clean weaves and natural hair separately. [step] Normally, you would want to wash your hair a few times a week. However, the lengthy time it takes to wash hair with a weave in makes it impractical to do more than once a week, and a weave may be damaged with excessive cleaning.\",\"endings\":\"['The main reason you are washing your weave by hand is to protect your natural hair from damaging more directly around its roots and then to prevent it from slipping back behind you. [substeps] Put your hair in a low ponytail if you want to prevent looking greasy.', 'To make sure you get all of your hair clean before trying to wash it, check the dyes on your weave. You can find dyes at big box stores, beauty supply stores, and online.', 'Washing your natural hair once a week, and washing your weave twice a month should be sufficient in most cases. Try to approach these two things relatively separately.', '[substeps] Wash your weave while it is still damp by gently running warm water over it. Do not use a natural conditioner while it is still damp.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}