{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f188b8e8-c426-549c-8c03-5c4846507e73","task_key":"default--validation--34109","task_revision_id":"1","upstream_id":"34109","short_description":"HellaSwag validation 34109","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to relax muscles [title] Try heating patches. [step] These patches work to dull pain, and then relax it away by reducing inflammation. Heat patches are sold over-the-counter at most convenient stores and can be worn when needed.\",\"endings\":\"['Specific usage directions on the package should be followed. [substeps] You can also try using an electric heating pad.', '[substeps] Plug in a heating pad and place it over the affected area of your body. The warmth of the heating pad provides the same benefits as hot washins and only burns off some of the tension in your muscle, rather than leaving behind scabs.', \\\"Always read the label to make sure the product is safe for you to use on a sensitive area. [substeps] Press a bag of hershey's or a tablespoon of peppermint essential oil into your skin while they are cold.\\\", 'Heat patches stimulate healing, which can also help you work out your muscles faster. It will also provide relief while you exercise.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}