{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"bf078cd8-a3cf-5163-aa0c-6957cdbec24e","task_key":"default--validation--19876","task_revision_id":"1","upstream_id":"19876","short_description":"HellaSwag validation 19876","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to choose healthy sources of protein [title] Buy lean cuts of meat and fish or trim off excess visible fat. [step] Lean cuts of beef, poultry, fish, and pork can be protein powerhouses. Just be sure to trim excess fat from cuts of meat or buy ground products that have low fat contents.\",\"endings\":\"['[substeps] For example, choose pork tenderloin instead of pork belly. Fresh meat from the butcher section of a grocery store is much less likely to have added salt, fat, preservatives, or sugar than canned, frozen, dried, or pre-packaged options.', '[title] Try enriched or \\\" plain \\\" lean sources of protein. [step] In addition to reducing the amount of fat on the meat, saturated fats provide a rich source of protein.', 'If you can, purchase lean cuts of meat that have a higher percentage of protein and higher levels of fat. [substeps] Lean cuts of beef, fish, and pork should be more frequent than lean cuts of meat, as meats may offer larger quantities of protein in addition to lower amounts of fat.', \\\"This will reduce the risk of a fat buildup in the meat. [substeps] If you're braising a lot of meat and aren't on the vegan diet, and are only braising small portions a week, ask your doctor if this will lower your total intake of protein.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}