{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"660d4095-4c99-544d-874f-9429df29deec","task_key":"default--validation--42307","task_revision_id":"1","upstream_id":"42307","short_description":"HellaSwag validation 42307","config":"default","split":"validation","body":"{\"activity_label\":\"Food and Entertaining\",\"ctx\":\"[header] How to roll fondant [title] Work on a clean, flat surface. [step] In many cases this will be your counter top. A marble or wooden chopping board works well if your counter is irregular in shape or has trenches in it from grouting.\",\"endings\":\"['An alternative is a writing utensil such as a spatula to work with; this will give you a broad, flat surface to work on and also provides you a moist surface to work on. [title] Choose a cutting board for your fondant.', \\\"Irregularities in your counter can make your fondant irregular when rolling. [substeps] Depending on the amount of fondant you're working with, you might only need a small area to work in.\\\", 'The roughness of the stone can make the method easier. [title] Chop your fondant dough into fits about an inch smaller than your pie filling.', '[substeps] Use a 220 grit pitcotta grinder for a smooth bottom. Add buttercream or sealant to the bottom and in the corners to give your workbench a nicer, finishing finish.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}