{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b7676496-93d7-5706-b194-e4d5904628ff","task_key":"default--validation--19638","task_revision_id":"1","upstream_id":"19638","short_description":"HellaSwag validation 19638","config":"default","split":"validation","body":"{\"activity_label\":\"Home and Garden\",\"ctx\":\"[header] How to keep weeds out of your vegetable garden [title] Cut with a sharp hoe. [step] A sharpened hoe blade allows you to sever the weeds without having to bend over or crouch. Swing the blade against the weed near the base, then leave the weed to decompose.\",\"endings\":\"['Most gardens come with a tool box or bucket to hold your tools and a butter knife. [substeps] Most rows with looser weeds are growing due to long rows of weeds.', 'Keep a hoe with thick bristles, protecting from the sun with your hands to stop weed growth. [substeps] Use the hoe to pull weeds along your garden for this purpose.', '[substeps] Splitting dandelion roots will produce tuberculosis, which can form naturally. Keep in mind that rooting weeds to promote well-draining soil changes the soil.', 'If vegetables are already growing, a thin-bladed \\\" onion hoe \\\" may be easiest to maneuver without damaging the useful plants. [substeps] If the weed already has visible seed pods or seed heads, pull these off before you cut, and discard them in a trash can covered or far away from your garden.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}