{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ddf8c674-2a53-5656-9455-a901a1437efa","task_key":"default--validation--26118","task_revision_id":"1","upstream_id":"26118","short_description":"HellaSwag validation 26118","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to wear flared jeans [title] Opt for high-waisted flares. [step] Low-waisted flares, also known as hipster jeans, feature an extremely low waist that starts just above the pubic bone and button or zip several inches below the navel. Hipster flares were a very popular look in the early 2000s.\",\"endings\":\"['[substeps] Streamlined flares come in a variety of sizes and styles. V-neck flares are top-tier and low-rise! They are short only for the waist of a fitting dress.', '[substeps] Look for flared flares if you like to draw attention to your sport. Cropped flares work to accentuate your figure rather than drawing attention to a smaller waist.', 'To achieve these flares, you will need a pair of low-rise jeans; standard skinny jeans, blue jean or a crop top is ideal. [title] Wear a short-sleeved t-shirt or tank top with high-rise jeans.', 'Flared jeans are definitely making a comeback, but not the low-waisted hipster versions, which can look dated. Go for high-waisted flares that sit above the hips and button above the navel.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}