{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"eb930c30-72a8-550d-87c7-6d13fea6e3f0","task_key":"default--validation--37463","task_revision_id":"1","upstream_id":"37463","short_description":"HellaSwag validation 37463","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to fake a facial piercing [title] Purchase some jump rings. [step] You can find jump rings at your local craft store or walmart. Jump rings are small and made of metal.\",\"endings\":\"['They usually have a small gap between the two ends of the ring. [substeps] Jump rings are the best decision if you want your hoop piercings to look as realistic as possible.', 'They can also come in a metallic color, such as pink or aqua. They can also come in a flower print.', 'Jump rings are a great way to fake your facial piercing without having to wear them. Jump rings make the process of fake piercing much quicker and easier.', 'To replicate the look, wear them for ten minutes and then take them off. Run your finger along the jump ring, then slide your finger down the ring.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}