{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4c8199e3-9021-5f60-8f0c-2841c4d3c372","task_key":"default--validation--10120","task_revision_id":"1","upstream_id":"10120","short_description":"HellaSwag validation 10120","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to make your own anti aging creams with vitamin c [title] Dissolve vitamin c powder using distilled water. [step] Mix a ½ teaspoon of vitamin c powder with 1 tablespoon (14. 8 ml) of distilled water in a small container. Make sure to mix the ingredients together until the powder is completely dissolved, to avoid a grainy mixture.\",\"endings\":\"[\\\"[substeps] Do not use vitamin c powder: it will not dissolve in water on its own, and can be runny. If you don't like the consistency, you can try diluting the powder in a small amount of water.\\\", '[substeps] The amount of use it takes depends on how flavorful your target acne acne is. It may take some experimentation on your part to find the right mix that works best for you.', '[substeps] Only use distilled water, not just filtered tap water or plain tap water. This is because the high oxygen levels in tap water can break down the ingredients faster.', \\\"[substeps] If you don't mind the consistency of some of the crystals, consider omitting the red powder entirely. The color and aroma of the paste will attract more flies and sap from the skin.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}