{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0169d2c4-e571-5474-bdec-860d19c1064a","task_key":"default--validation--23056","task_revision_id":"1","upstream_id":"23056","short_description":"HellaSwag validation 23056","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to wear dresses with boots [title] Match the boots with the style of the dress. [step] Try to pair the style of boots with the style of dress you're wearing. For example, a pair of chunky, motorcycle boots wouldn't work well with a light, flowing dress, but they would work well with a leather dress.\",\"endings\":\"[\\\"[title] Choose a form-fitting boot for snow boosts. [step] This is a great option for mountain walking, but it doesn't work with snow biking.\\\", 'The boots part should begin somewhere around the ankle and end around the small of the back of the dress. [substeps] Pair a fitted dress with a structured blazer for a bit of bohemian chic and an oversized blouse for a more professional look.', 'Rather than wearing regular dress dress shoes, pair a pair of high-heeled boots with the style of the dress. [title] Wear motorcycle boots with a business casual or work casual outfit.', \\\"Also, a pair of brown ankle boots wouldn't look good with a leather dress, but they would work well with a light, flowing dress. [title] Wear boots that are formal or casual enough for the occasion.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}