{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f734c6d3-7264-503c-9a07-56b16333a244","task_key":"default--validation--28415","task_revision_id":"1","upstream_id":"28415","short_description":"HellaSwag validation 28415","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to interpret echocardiograms [title] Ask your doctor how big your heart is. [step] If your heart is enlarged or the walls of your heart have become thicker, this can be in indication of several problems. For example, the doctor will likely measure the thickness of the wall of the left ventricle (the major pumping chamber of the heart).\",\"endings\":\"['If it is thicker than 1.5 cm, this is considered abnormal. This or other thickened heart walls could indicate several problems including : [substeps] High blood pressure weak heart valves damaged valves [title] Determine the strength with which your heart pumps.', 'Then, they will measure the thickness of the left ventricle (the largest but then the central artery that carries blood oxygen to the heart) and record it in their chart. [substeps] These measurements will help you determine if the ekb probe is accurate.', 'If your heart is enlarged, it could be a sign of neuropathy. A doctor with echocardiogram is likely to suggest that you apply pressure on the right ventricle, the meaty area of the human body, with your hands.', '[title] Note any changes to your blood pressure. [step] Many people may notice any drastic changes in their blood pressure due to testing.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}