{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"91c57562-d847-595a-a90b-af65962411a7","task_key":"default--validation--49282","task_revision_id":"1","upstream_id":"49282","short_description":"HellaSwag validation 49282","config":"default","split":"validation","body":"{\"activity_label\":\"Home and Garden\",\"ctx\":\"[header] How to identify cutworm damage [title] Identify the type of cutworm. [step] By looking for specific feeding characteristics of a type of cutworm, you can better identify plant damage. [substeps] Look for black cutworm damage.\",\"endings\":\"['Put a pair of microscope gloves on and find out if the microscope sensor has brown discharge. Sometimes the bacteria will appear in the microscope, so look in small and individual areas.', 'The most common type of cutworm is characterized by white heart spots. However, there are more complex types of wart such as white but purple, black, yellow, and white streaks.', \\\"The herbaceous aceous land usually has a thick, black iron-like lump about four times larger than a regular dog's original growth. This lump is not usually especially active, but when they urinate infrequently it is usually caused by an infested area with an insect.\\\", 'The largest black cutworms , 1 1/4 inch (32 mm) in length, will cut the stems at the base of plants. The smallest (less than 1/2 inch or 12 mm in length) will feed on the leaves of garden plants.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}