{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"05344c30-f973-50a6-9f36-c332f3620748","task_key":"default--validation--31450","task_revision_id":"1","upstream_id":"31450","short_description":"HellaSwag validation 31450","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to identify the denier of hosiery [title] Understand the basics of denier. [step] The following facts are useful to keep in mind when selecting your hosiery : [substeps] The lower the denier, the more sheer the hosiery is. The higher the denier, the more opaque the hosiery becomes.\",\"endings\":\"['The more often there are transferrable fixtures that may attract paint in the rainy season, the more opaque it may appear. This is because water drains through pores, making the containers difficult to coat with paint.', 'Modern styles can manage to make sheer hosiery at a higher denier to provide strength and sheerness-it depends on the brand and will definitely cost more. [title] Learn the qualities of each denier range.', 'The higher the denier, the more transparent the colors. The denier blends more easily with the store-bought look.', 'When a hosiery is wool-coated, the material is more transparent; when not wool-coated, it is darker and richer than normal. The higher the denier, the lighter the fabric.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}