{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"65c09646-5ea5-5ab4-84c6-99f41e1aa2be","task_key":"default--validation--34721","task_revision_id":"1","upstream_id":"34721","short_description":"HellaSwag validation 34721","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to choose a summer beach wedding dress [title] Choose light fabrics. [step] The first thing that needs to be considered while shopping for a summer beach wedding dress is the fabric. Go for lightweight fabrics to keep you cool and comfortable on your big day.\",\"endings\":\"[\\\"Lightweight fabrics are so that they won't be slippery on your wedding day. [substeps] Go for cotton or linen dresses made of heavier materials.\\\", 'You can buy a wedding dress from a local show designer but it should be made of lighter fabrics such as chiffon, crepe, cotton eyelet, cotton organdy, organza, georgette and voile. [title] If your budget for a wedding dress is high you can buy a designer wedding dress for your summer wedding.', \\\"If you're planning to wear a suit to work the more light fabrics you can purchase are good choices since these are designed as functional swimsuits. [substeps] Prefer something that is breathable so that you don't sweat as much.\\\", 'Light pastels (like light blue, turquoise, or pink, etc. ), light cotton fabric (like cotton singapore), cotton breaded with fabric, and light baby pink or mint green fabrics (like cotton pantyhose or maxi dresses) are good options.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}