{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7ea59955-8397-51fa-8479-bd347f171b8f","task_key":"default--validation--14443","task_revision_id":"1","upstream_id":"14443","short_description":"HellaSwag validation 14443","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to choose a massage oil [title] Determine the type of massage. [step] Heavier oils, such as olive oil, work best for low-friction massages such as swedish or relaxation. These oils are slipperier and don't absorb as quickly into the skin.\",\"endings\":\"['[title] Define the type of massage oil you want before purchasing it. [step] It may be the type you want to enjoy beforehand, or it may be something relaxing like body and hair oil.', 'Lighter oils, such as grapeseed, and creams work best for high-friction massages, such as sports and deep tissue. These oils absorb more quickly to prevent you from slipping as you apply more pressure but provide enough glide to prevent irritating the skin.', \\\"Heavier oils such as lemon oil oil, herbal oil, or coconut oil work best for low-friction massage. [title] Review your manufacturer's description to see what type of oil you need.\\\", 'Heavier ones, such as almond oil, can pull the skin apart and cause further irritation. [title] Consider an oil that stimps out and lenates itself well.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}