{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"87485a05-55e0-5f51-8403-cf6ce4babbee","task_key":"default--validation--6991","task_revision_id":"1","upstream_id":"6991","short_description":"HellaSwag validation 6991","config":"default","split":"validation","body":"{\"activity_label\":\"Home and Garden\",\"ctx\":\"[header] How to avoid common composting mistakes [title] Avoid placing animal products into your compost pile. [step] An easy composting mistake can be avoided by leaving fats, dairy, meat, and bones out of your compost. These materials will go rancid and generate unpleasant odors as well as attracting rodents and other unwanted animals to your compost.\",\"endings\":\"['[substeps] Common organic composting items include eggs, fish, pork, corn, white rice, kidney beans, and chicken. Avoid sharing bones or bones of animals, such as chickens, pigs, squirrels, and rabbits.', 'Meats and dairy also provide a breeding ground for harmful pathogens. [title] Ensure that the moisture level in your compost pile is ideal.', 'Resist the temptation to put meat or dairy products in your compost pile. This will keep your compost pile warm and healthy and may prevent rodents from filling or eating your compost pile.', 'Using animal products such as chicken manure or sawdust is a safer bet. [substeps] Possible alternatives include a trash can or large plastic pail beneath your compost pile.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}