{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4dbc0caf-4ccc-5c01-90fa-a68d273b8a47","task_key":"default--validation--35839","task_revision_id":"1","upstream_id":"35839","short_description":"HellaSwag validation 35839","config":"default","split":"validation","body":"{\"activity_label\":\"Food and Entertaining\",\"ctx\":\"[header] How to make fried chicken [title] Prepare the escalopes. [step] Remove the skin and tendons from the chicken. Put the chicken fillets between two sheets of plastic food wrap or parchment paper and pound with a rolling pin.\",\"endings\":\"[\\\"Scoop out medium size pieces of chicken and roll them into quarters. [substeps] The approximately 2½ pounds is enough to make one half pound but you'll also need about two 20 pound rolls that you can spare.\\\", 'The aim is to flatten them evenly to about 1 centimeter (0.4 in) (1/2 \\\") in depth. The flattened pieces are now known as escalopes.', '[substeps] Do not overcook the chicken. Because there is no need to do so, you should make sure that you thoroughly slice the chicken into one or two thick slices before cutting it into four equal chunks.', 'Hold the wrap at a 45 degree angle and pound until it breaks up and falls off. Place the chicken pieces in a blender and puree.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}