{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0a650be2-051c-504c-925e-c59b47261dfa","task_key":"default--validation--35921","task_revision_id":"1","upstream_id":"35921","short_description":"HellaSwag validation 35921","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to buy scrap silver [title] Educate yourself about silver in all its various forms. [step] Diversify your sources of information. Read books about gold and silver scrap dealing, as well as the blogs of dealers.\",\"endings\":\"['Dig through the depths of your own knowledge to get a good idea of what gold will look like to a consumer. [substeps] Check the various silver mining sites within the us to show where the silver is being mined.', 'Explore gold and silver plating and scrap dealers, from online buyers to independent dealers. [title] Understand the purpose of gold sifting.', 'If these are only what you know, then you should locate gold dealers online who might offer some valuable information to you. Read online shop journals for date and time books and database books on any specific alloy (including gold), such as nickel.', 'Many dealers post scrap buying and selling tips online. Learning about silver buying means learning about the scrap dealing market and about silver itself.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}