{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e7d61c86-7637-5261-b69c-b4f7069e8528","task_key":"default--validation--2764--variant-cd16769d9dbe","task_revision_id":"1","upstream_id":"2764--variant-cd16769d9dbe","short_description":"HellaSwag validation 2764","config":"default","split":"validation","body":"{\"activity_label\":\"Food and Entertaining\",\"ctx\":\"[header] How to make bananas ripen faster [title] Put the bananas in a paper bag. [step] Bananas produce ethylene gas, a hormone that triggers ripening. Keep them in a paper bag to trap more of this gas near the fruit.\",\"endings\":\"[\\\"Large, unripe bananas are a good bet, as they can continue to produce ethylene gas through ripening. [substeps] One big bowl works well, since large, unripe bananas won't spoil right away.\\\", '[substeps] Resist the urge to squeeze the bananas. Wrap the bag lightly with a rubber band or otherwise press them down gently with enough pressure to help them ripen quicker.', '[substeps] Avoid paper bags with a clay or waxy coating, which may absorb the ethylene. A plastic bag blocks oxygen from reaching the fruit, which can sometimes lower the production of ethylene.', \\\"Cheesecloth bags produce ethylene gas too, so if you're using cheesecloth bags, place them in a tightly closed bag. If working in a garage, clean immediately.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}