{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3a912643-4609-5c7b-a206-99f5831ae9ce","task_key":"default--validation--32464","task_revision_id":"1","upstream_id":"32464","short_description":"HellaSwag validation 32464","config":"default","split":"validation","body":"{\"activity_label\":\"Education and Communications\",\"ctx\":\"[header] How to freeze rice [title] Cook up some fresh rice. [step] Rice freezes best when it's still full of moisture. Heat up a batch of your favorite style of rice in your rice cooker or on the stovetop.\",\"endings\":\"['There are two types of rice besides made-up rice : [substeps] Dried rice. This actually has less moisture and lower starch content, resulting in smooth cooked rice.', \\\"Whatever's left over can go in the freezer. Preparing and freezing rice in bulk at the beginning of the week can free up a lot of time that you would otherwise spend fixing individual batches.\\\", \\\"[substeps] If you're not a fan of canned rice, you can use steamed, or roasted rice instead. Make sure to wear sensible cooking shoes, socks, and/or gloves when handling fresh rice.\\\", 'The rice will be ready once all the moisture has been absorbed and the sweet texture returns. Try fresh rice made from natural ingredients, such as chicken, mushrooms, onions, or turnips.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}