{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"008aa69b-3c37-514f-b050-fef1aeda5144","task_key":"default--validation--7144","task_revision_id":"1","upstream_id":"7144","short_description":"HellaSwag validation 7144","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to keep a pear tree healthy [title] Choose the best variety of pear tree for you. [step] Choose a fire blight resistant variety that will thrive in your local climate. If you plant a pear tree that doesn't do well in your area, you will most likely have a sick tree on your hands, no matter how well you take care of it.\",\"endings\":\"[\\\"[substeps] Pear trees planted between october and november should not be grown in the sun. Tree conditions that are too hot and humid (above 100 f) can damage the pear tree's main branches to the most detriment.\\\", '[substeps] If you want a tree that grows just about anywhere, it is a good idea to replant it in your area. When selecting a pear tree, look for one that grows almost anywhere in your area.', 'Remember some pear varieties are better for cooking and some better for eating straight from the tree. [substeps] Talk to an employee at your local plant nursery to determine what kind of pear trees thrive best in your area.', 'Also, care should be taken to keep an pear tree healthy in your area. [substeps] Perennial trees tend to be most successful in hot temperatures during the early fall and early spring months, so a pear tree that grows too young can become damaged in hot summer weather.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}