{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"352568d7-0ac4-53ec-8c66-fb8ee88d269a","task_key":"default--validation--28388","task_revision_id":"1","upstream_id":"28388","short_description":"HellaSwag validation 28388","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to cut expanded metal [title] Get the right tools. [substeps] Like any other cutting processes, to cut expanded metal successfully, you have to choose the right tools and equipment which will aid the cutting process. Some of these tools and equipment include: cutting tool; there are very many grinders which are available in the market.\",\"endings\":\"['Choose a grinder depending on the nature and size of the expanded metal to be cut. Measuring device; you can opt for either a ruler or a tape measure.', 'The most common grinders used are sharpened wood, ding armature steel. Some grinders used are thought highly fitting for cutting larger holes, or shayers which have been used for the advancement of a vibrating steel engine.', 'Pick one, but make sure you go with one that is hot and friendly. Two or three grinders require a different type of grind to cut and lubricate the metal.', 'Hardware you can cut yourself in some places such as woodworking or laying furniture. You can even pick up a saw and use it to create shapes and designs.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}