{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"bb9b3031-6cb6-59eb-88f6-5ce692f2841f","task_key":"default--validation--22560","task_revision_id":"1","upstream_id":"22560","short_description":"HellaSwag validation 22560","config":"default","split":"validation","body":"{\"activity_label\":\"Pets and Animals\",\"ctx\":\"[header] How to feed a guinea pig [title] Feed your guinea pig hay. [step] Guinea pigs love hay! They need it for digestive and dental health. Guinea pigs should have unlimited access to hay, which often means refilling a good-sized dish 3 to 5 times daily.\",\"endings\":\"['The amount of hay you feed your guinea pig should always be somewhere between an over sized dish and an empty one. Remember not to feed your guinea pig hay that is not hemp hay.', 'Timothy hay will provide good feed for them, but is not as naturally nutritious as hay from your local feed store. [title] Buy feeding bowls with straw at the bottom of them.', '[substeps] Combine timothy hay with grass hay (100 g or 1/2 to 1/4 cup) whenever possible. Hay is a great source of solid protein that your pet needs.', \\\"[substeps] Timothy hay is the best hay for all guinea pigs in general. They will happily eat it and play with it, and it's healthy for pigs of all ages.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}