{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"365c8b21-781f-5d30-87b8-13ba7118847d","task_key":"default--validation--3926","task_revision_id":"1","upstream_id":"3926","short_description":"HellaSwag validation 3926","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to diagnose itp [title] Look for excessive bruising and pinpoint bleeding. [step] With this condition, you may bruise very easily or have reddish purple spots on your skin called purpura. Alternatively, you may notice tiny red-purple spots, called petechiae.\",\"endings\":\"['Petechiae usually appear on your legs. [substeps] Purpura appear when small blood vessels burst under the skin.', '[substeps] However, you may also experience blood vessels that leach blood into your heart or rupture when bleeding occurs. Blood vessels are the lymph nodes that connect all organs in your body.', '[substeps] The most severe cases of these bruises occur between the epigastric vessels, which are the natural openings for blood to flow. The blood vessels that flow to them are not as absorbent as those that plug them.', 'These abnormal colored areas can be easily infected. [substeps] If you have these symptoms infrequently, get medical help right away.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}