{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f5024b23-5ca3-55b4-b2e9-d869032cc5f5","task_key":"default--validation--34074--variant-a4cb69370c08","task_revision_id":"1","upstream_id":"34074--variant-a4cb69370c08","short_description":"HellaSwag validation 34074","config":"default","split":"validation","body":"{\"activity_label\":\"Home and Garden\",\"ctx\":\"[header] How to prevent spider mites on houseplants [title] Keep your houseplants hydrated. [step] Watering your houseplants as needed on a regular basis will prevent spider mite infestation, since spider mites only thrive on houseplants that are dry. [substeps] Use cold water instead of lukewarm water to water your houseplants.\",\"endings\":\"['It is recommended to be sure that every day you water your houseplants, you may see spider mites appear on the \\\" float \\\" on the water bottles. In some cases, spider mites may appear as large clusters, rather than a single cluster.', 'If you do not have a tank, place plants in small jars or bowls that can drain into the tank regularly. [title] Plant your plants in terracotta or porcelain pots.', 'This may prevent weak, poorly hydrated houseplants from being able to survive an infestation. [title] Defrost your plants every six to eight weeks.', 'Spider mites will not infest your plants if the temperature is too cold. [title] Remove dust from your houseplants once per week.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}