{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f3312010-d432-5860-999b-5ecb73668b89","task_key":"default--validation--13724","task_revision_id":"1","upstream_id":"13724","short_description":"HellaSwag validation 13724","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to choose workout leggings [title] Look for compression styles for intense activities. [step] Compression fabrics are tightly woven to help increase the circulation in your legs. If you're engaging in an intense workout such as running or kickboxing, they can help reduce your soreness following your workout.\",\"endings\":\"['[substeps] Compression materials let you stretch more quickly than materials like exercise pants. Compression fabrics also give your legs an outlet that can keep you from putting on extra weight.', \\\"[substeps] Compression leggings tend to be more expensive, so unless you're engaging in high-intensity activities they may not be necessary. However, they have an added benefit of making your legs look taut, your muscles more defined.\\\", 'Loose, flowing styles can also help strengthen your muscles. The easiest way to select the right compression leggings is to look for one that will allow you to enjoy your workout without feeling the need to lengthen the gaps in your muscles.', \\\"Wear compression leggings if you're running most days or cycling. Generally, compression styles are loose jogging leggings that hug your legs at lower hips and let you kick more comfortably and run more comfortably.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}