{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"63b3db0e-7b3e-5958-963a-d64686e45c8a","task_key":"default--validation--49139","task_revision_id":"1","upstream_id":"49139","short_description":"HellaSwag validation 49139","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to check lymph nodes [title] Locate your lymph nodes. [step] You have the highest concentration of lymph nodes in your neck, collarbone, armpits, and groin. Once you know where they are, you will be able to check them for pain or swelling.\",\"endings\":\"['[substeps] To identify your lymph nodes, look at your earlobe or high neck. To perform a blood test, attach a needle at the corresponding carotid artery.', '[substeps] Identify them with an eye dropper or a syringe. The eye dropper or syringe should be attached by cord to a length of flexible metal tubing or cleat.', '[substeps] There are other groups of lymph nodes throughout the body, including the inside of your elbows and knees, but these are not commonly checked for swelling. [title] Test an area with no lymph nodes for comparison.', 'Nodes can be found using this tool : [substeps] Find your very appropriate area of the neck. The most important areas are your lymph nodes, located across the top of your neck.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}