{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7d603334-6004-5f78-8930-4da2118de765","task_key":"default--validation--6671","task_revision_id":"1","upstream_id":"6671","short_description":"HellaSwag validation 6671","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to choose rose gold wedding jewelry [title] Choose rose gold for affordability. [step] Rose gold is sometimes cheaper than other types of gold because it is an alloy. Gold is mixed with copper to form rose gold, which is what gives it its rosy hue.\",\"endings\":\"['Rose gold will look much brighter on jewelry, as it could be broken into two primary types of jewelry : [substeps] Engagement rings and engagement rings. These are the common types of jewelry that people select to obtain rose gold for their rings.', 'Rose gold does not contain added dpi and also is not a mineral. To identify rose gold at home, click to find the selection to the right.', 'Copper is usually cheaper than gold, making the metal more affordable overall. [title] Look at rose gold for durability.', 'The two metals (gold and copper) work best together, especially in varying amounts. [title] Choose rose gold jewelry if you want to use it as a decorative item or as a gift for a deceased relative.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}