{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f09b9870-70fe-5825-a869-d16926944794","task_key":"default--validation--16391","task_revision_id":"1","upstream_id":"16391","short_description":"HellaSwag validation 16391","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to get beautiful, glowing skin [title] Drink up. [step] Aim to get 6 to 8 glasses of water a day. The water will clear your skin and make it glow because it makes it easier for your body to flush out toxins quickly.\",\"endings\":\"['Fruit juices or energy drinks will also help flush out toxins. You can also take a 12 ounce glass of mineral spirits and drink it with tea and pills; it is thought to reduce inflammation and other body irritations.', 'Get yourself a cup of water and add a splash of lemon juice to the water. Drink this up as fast as you can.', \\\"[substeps] Carry a water bottle with you all day to make sure you always have water on hand. Drink herbal tea or other non-sugary beverages to hydrate when you're tired of water.\\\", '[substeps] To get a good amount of water, avoid the us water standard, which states that you drink 8 glasses of water everyday. If you are pregnant, do not over-hydrate and do not drink anything outside the 8 glasses of water recommended by your doctor.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}