{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"25031980-de57-5874-8924-e6f41efcc020","task_key":"default--validation--43443","task_revision_id":"1","upstream_id":"43443","short_description":"HellaSwag validation 43443","config":"default","split":"validation","body":"{\"activity_label\":\"Home and Garden\",\"ctx\":\"[header] How to grow vietnamese mint [title] Plan to grow vietnamese mint in the spring or summer. [step] Vietnamese mint can be grown in most climates so long as they have warm, sunny weather. Avoid planting your mint in the fall or winter, if possible, and wait until the weather gets warmer in your area.\",\"endings\":\"['The year difference in temperature can cause leaves, flowers, and stalks to re-rot. [substeps] If you live in a temperate area, you will need to wait until spring to plant vietnamese mint.', \\\"[substeps] Unfortunately, vietnamese mint doesn't thrive in cooler climates, especially in temperatures over 95 degrees fahrenheit (20 degrees celsius). [title] Plan to keep a pot full of vietnamese mint.\\\", 'If you live in the northern hemisphere, place your mint to grow in autumn or spring. [title] Do not plant your mint in sunny weather.', '[title] Propagate vietnamese mint from cuttings. [step] Vietnamese mint is best grown from clippings.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}