{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"23d2cf52-0a7f-5585-bbce-f52d986be178","task_key":"default--validation--45813","task_revision_id":"1","upstream_id":"45813","short_description":"HellaSwag validation 45813","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to spot fake nikes [title] Investigate nike shoes sellers on the internet. [step] Be extremely cautious when purchasing nike shoes on the internet. Since you don't actually have the physical product in front of you, you can very easily be throwing money at a fake shoe.\",\"endings\":\"['When deciding whether to purchase nike shoes, make sure to inquire whether they are legitimate and professional-only. The more you know about which shoes the real gucci is, the more suspicion you will have.', 'You can prevent ruining your beautiful nike shoes by investigating sellers on the internet. Purchase nike shoes from sellers on the internet.', 'To avoid purchasing a fake : [substeps] Read website ratings and reviews before buying anything. Bad reviews is an obvious sign that the seller is not reliable or reputable.', \\\"This is simply because fake nike shoes are misleading. Snowggers in the uk and some national brands are low-quality real nike shoes, but you'll eventually find the shoes that you're looking for.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}