{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"62feae51-4759-572a-be27-48ec3e136b48","task_key":"default--validation--27655","task_revision_id":"1","upstream_id":"27655","short_description":"HellaSwag validation 27655","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to make homemade bath salts [title] Prepare your ingredients and supplies. [step] Along with the required and desired extra ingredients, you will also need some tools and supplies, including a : [substeps] Baking sheet mixing bowl and spoon (or a resealable plastic bag) spatula [title] Mix your salts. [step] There are many popular salt choices for bath salts, many of which are sea salts.\",\"endings\":\"[\\\"For example, there are indian and brazilian sea salts, in addition to the salami, cod, etc. Already in your pantry, it's also a good idea to choose the best of all the salt for your bath salts.\\\", 'Follow the rules for mixing with your salts, including using table salt, cafe salt, and coarse sea salt. [substeps] To adjust your salt, place your salt in the refrigerator overnight.', 'Doing so is, in some cases, simple. [substeps] Plain sea salt is the most common type of sea salt, which helps the salt bond to the skin.', 'You can mix and match your salt ratios depending on your personal preferences. With a spoon, mix together the desired portions of salt together in a medium bowl.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}