{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8b8b1d4f-6fab-5f5e-b47a-b02fdaa1fb79","task_key":"default--validation--20953","task_revision_id":"1","upstream_id":"20953","short_description":"HellaSwag validation 20953","config":"default","split":"validation","body":"{\"activity_label\":\"Home and Garden\",\"ctx\":\"[header] How to use a clothes steamer [title] Learn which fabrics can be steamed and which ones cannot. [step] Steamers work wonderfully for most fabrics, as steaming is a delicate method of de-wrinkling. Fabrics that can be steamed include most cottons, silks, wools, and polyesters.\",\"endings\":\"['Experiment around different fabrics to discover what seems to work best for your particular fabric. [substeps] If you have a custom steamer, you can always steam the fabrics in a different area.', 'Find the traditional steamers available at your local department store and shop around for the ones that can withstand the steam treatment. If possible, use muslin for this process.', '[title] Pour the water into the steamer steamer box. [step] Use a steady, even stream to pour the water into the steamer box.', 'However, some fabrics should not be steamed. These fabrics include waxed jackets, suede, or materials that may melt, such as plastic.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}