{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"93739f03-4cc4-51aa-ba92-cc0a9733ce96","task_key":"default--validation--14730","task_revision_id":"1","upstream_id":"14730","short_description":"HellaSwag validation 14730","config":"default","split":"validation","body":"{\"activity_label\":\"Food and Entertaining\",\"ctx\":\"[header] How to braise beef [title] Select an inexpensive cut of meat to braise. [step] While it may seem contrary to usual meat-buying logic, tougher or less-tender cuts of meat are perfect for braising. Pot roast, chuck roast or any inexpensive cut may be used.\",\"endings\":\"['The muscle fibers and connective tissue that make these cuts stringy or tough are broken down by braising, which gelatinizes the collagen into a more palatable texture. Low heat and long cooking times are used to make a tough cut of any kind of meat moist, tender, and delicious, when cooked properly.', '[substeps] Nuts, seeds, fruits or vegetables should all go in a braised beef braise, but they should also be toasted or consumed free of fats, juices or oils. Select these nutritious cuts of beef in the same way you would others.', 'Tenderloin is good options because it cuts a bit higher than other varieties of beef and burgers. Olive oil can make braised beef much richer.', \\\"Steak is a different type of meat and you'll need to be willing to share that with others at a restaurant. [substeps] Choose beef products from dachshunds, beef liver or split beef bones available at your local butcher or grocer.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}