{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5365def1-4da0-5db1-bae5-1e8799df9073","task_key":"default--validation--3631--variant-a051b07bab23","task_revision_id":"1","upstream_id":"3631--variant-a051b07bab23","short_description":"HellaSwag validation 3631","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to straighten hair with heat protection spray [title] Start with wet hair. [step] Make sure that your hair is clean and has been properly conditioned. If you shampooed, ensure that all of the shampoo is washed out of you hair before applying conditioner.\",\"endings\":\"['[substeps] If you shampooed your hair, do not use any conditioner in your hair right before brushing or deep conditioning it. A good rule of thumb is to not use conditioner in your hair after washing it.', 'Rinse your hair with cool water before stepping out of the shower. A cool rinse ensures that your hair follicle is closed tightly and minimizes hair loss.', \\\"[substeps] Ensure that when using gels to dry your hair, it is completely dry. If you're using heat styling products, it is necessary to separate your hair into sections and then comb your hair into the section.\\\", 'If your hair is wet, you risk it having clay and buildup on it. [title] Prepare your blow dryer for this part.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}