{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4140dfd1-bbdb-56bb-87ac-73c209f0577a","task_key":"default--validation--43282","task_revision_id":"1","upstream_id":"43282","short_description":"HellaSwag validation 43282","config":"default","split":"validation","body":"{\"activity_label\":\"Computers and Electronics\",\"ctx\":\"[header] How to get rid of head lice naturally [title] Wet-comb your hair. [step] Use a fine-toothed nit comb to comb the entire length of wet and lubricated hair. This may remove lice and some of their nits, or eggs, if done for several weeks.\",\"endings\":\"['[substeps] Curly hair can be rubbed down by rinsing with hot water and then sprayed on with a shiny hairspray, or it can stay wet for two to three days. [title] Shampoo your hair if it is dry.', \\\"[substeps] Lice are not necessarily sexually transmitted. While it's perfectly normal for lice to burrow into hair, it's not always so.\\\", \\\"[substeps] Your trimmer's clippers can also be used on dry hair because the blades may shave more off of your hair. Take your hair dry when you get out of the shower or bath to avoid pulling the lice out of your hair when they are still on your scalp.\\\", '[substeps] Purchase a nit comb at a pharmacy, grocery store or another large retailer. Wet the hair with water and use something such as hair conditioner to lubricate it.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}