{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0e0a111c-d580-54c4-b94b-1ee3142e6cf6","task_key":"default--validation--381","task_revision_id":"1","upstream_id":"381","short_description":"HellaSwag validation 381","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to know if a versace bag is real [title] Enter in the clg code. [step] All versace bags come with a built-in authenticity code known as the certilogo of clg. This code is 12-digits long and usually located on the label or hang-tag of the bag.\",\"endings\":\"['It can help you to know whether the bag is real if looking inside the bag. [title] Locate the button on the side of your bag.', 'The code will indicate whether or not the bag is authentic. [substeps] For example, it might look like this: sity 127 lb.', \\\"Once you've located the code you can then go to the certilogo website and enter it in to verify authenticity. [substeps] Be aware that the clg code information must be kept with any bag that is returned.\\\", 'It is the most common code used to verify authenticity. Upon opening the bag, the word \\\" clg \\\" will appear next to the name of the bag.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}