{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5d869754-9bb3-513b-a20d-5fb015594cca","task_key":"default--validation--3898","task_revision_id":"1","upstream_id":"3898","short_description":"HellaSwag validation 3898","config":"default","split":"validation","body":"{\"activity_label\":\"Home and Garden\",\"ctx\":\"[header] How to make oven fried onion rings [title] Cut the ends off the onions. [step] Start by using a sharp kitchen knife to remove both ends of each onion. Aim for the fibrous white or brown eye on either side, and try to minimize the amount of vegetable you take off with it.\",\"endings\":\"[\\\"[substeps] Make sure you're using a solid cutting board, as you may need to apply quite a bit of force to get through larger, tougher onions. For a more efficient cut, slice the onions with a smooth lever action rather than a crude sawing motion.\\\", '[substeps] If you are using the precooked onion rings because they look cooking brown, you are in luck. Remove all the vegetables from the outer layers of the onion rings.', \\\"[substeps] Use a vegetable peeler to loosen any seeds or dried hair in the onion that might have collected on the leaves. These are the parts of the onion that you'll find later in this step.\\\", '[title] Shred and place onion rings in a food processor. [step] Now, use a fork to mince onion rings up into strips.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}