{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"80a5ff06-1cfa-5c70-80e9-09a6142a2130","task_key":"default--validation--11810","task_revision_id":"1","upstream_id":"11810","short_description":"HellaSwag validation 11810","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to buy a cubic zirconia ring [title] Gather basic information. [step] Before you can order any type of ring, you must know what you are shopping for. [substeps] Cubic zirconia rings are sized on the same scale as any other type of ring.\",\"endings\":\"['The ring size also determines how well they deliver nutrients and helps regulate pulse rates, which are natural cardiovascular rhythm indicators. [title] Decide if you would prefer a more robust ring or a more traditional metal ring.', 'You may find your ring size using a standard sizer, or you may go into any jeweler and have them size your finger for you. Remember that you have the same style options with cz as you do with any type of precious stone, so will need to choose between circle, oval, pear, princess and square cuts.', 'If you are having trouble finding a specific type of cubic zirconia ring, you can ask a jewelers or other online retailers for specific sizing charts. You can also search online for cubic zirconia rings at department stores and at specialty coffee shops.', 'They range from fairly large to perfectly fit into a clutch or purse. A standard-size ring cannot fit in a clutch.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}