{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ed4957c0-651b-56fd-9863-35a394a22542","task_key":"default--validation--8510","task_revision_id":"1","upstream_id":"8510","short_description":"HellaSwag validation 8510","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to be more like a french woman [title] Stick to the basics. [step] One of the most easily observable aspects of french fashion is the pared-down aesthetic so common to parisian streets. Rather than bathing in bright colors, or rushing out to buy the latest fast-fashion trend, french women stick to the basics, both in cut and color.\",\"endings\":\"['[substeps] Stay away from tight-fitting tops and baggy jean pants, and focus on keeping your legs length-wise. The choice of shorts or skinny jeans is more important than your footwear.', '[substeps] A flattering cut will outshine a trendy item. When purchasing clothing, make sure it fits your frame well.', 'By simply minimal clothing, you expose more skin than you actually may. Avoid wearing an outdated or revealing swimsuit.', '[substeps] This includes brightly colored hats, skirts and other stunning decorative items. Black or drab cardigans and leis are the most common plaid or tucked-in wardrobe choices.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}