{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"45e6f03e-e466-58d8-988c-c9cd6057ac95","task_key":"default--validation--13693","task_revision_id":"1","upstream_id":"13693","short_description":"HellaSwag validation 13693","config":"default","split":"validation","body":"{\"activity_label\":\"Computers and Electronics\",\"ctx\":\"[header] How to eat defensively (hiv positive individuals ) [title] If possible, prepare small quantities of food and consume immediately. [step] It it not wise to keep prepared foods for long periods of time as this gives bacteria the opportunity and time to multiply. [title] Eat properly cooked foods.\",\"endings\":\"['[step] Avoiding using preservatives, margarine, butter, salt and other processed foods can kill the bacteria responsible for the infestation and lead to an increased incidence of the virus. [title] Avoid grains and other starchy foods.', '[step] Foods should not be partly cooked or raw. It is safer to eat foods that are cooked fully, as exposure to high temperatures for longer periods will kill off any viable bacteria present in the foods.', '[step] If you stay out in unprotected, bacteria will race to the surface. Therefore, it is important to eat from clean pans and bowls and use the proper attire for cooking as soon as possible, it is a good idea to focus on maintaining some kind of simple survival mechanism.', '[step] The bacteria then spreads to the cells, the body and even to the tissues. [ coli coli is a type of bacteria that follows haemophilus bacteria.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}