{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"1beb8811-fbda-54e0-8022-406d8413c8b3","task_key":"default--validation--43044","task_revision_id":"1","upstream_id":"43044","short_description":"HellaSwag validation 43044","config":"default","split":"validation","body":"{\"activity_label\":\"Home and Garden\",\"ctx\":\"[header] How to discourage skunks in your garden [title] Discourage skunks in your garden by eliminating their access to the food source. [step] The best approach is to fence your garden. Put cages around the plants and cover the berries with netting.\",\"endings\":\"['Closing or blocking off the plants is crucial to repel skunks away from food sources that it is unlikely it will find. [title] Place charcoal in the center of the garden.', 'You can also put electric fencing on the plants, separating them. For particularly hungry skunks, the first thing you should do is put a fence around the garden.', 'Also, install mulch to keep the plants protected, although it does not prevent skunks. It is too cold to mulch, so do not disturb your plants until it has cooled down.', '[title] Choose species of plants that repel skunks. [substeps] Plant squash around the perimeter of your garden.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}