{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"cc2da8f7-66d0-568d-ab44-595dbba04c08","task_key":"default--validation--33601","task_revision_id":"1","upstream_id":"33601","short_description":"HellaSwag validation 33601","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to choose a skin care line [title] Determine your skin type. [step] Knowing your skin type is essential to finding the right products to care for it. The basic types are normal, oily, dry, and combination.\",\"endings\":\"['There are over twenty different skin types, from blemish-like to best-kept. [substeps] Oily skin is more often said than liked by men in intimate environments.', '[substeps] Oily skin: wash your face in the evening before your normal morning routine to remove grease and oils from your face. Acne is one of the different skin types: oily and combination acne: this is due to acidic flavanoids found in the skin.', 'Your type is determined by the size of your pores, the degree of oil and moisture in your skin, and its sensitivity to environmental irritants. [substeps] You have normal skin if you have few imperfections, no significant sensitivities, and small pores that are barely visible.', '[substeps] Oily skin is prone to pimples, shaves, and burns, while oily skin can cause dark circles and blackheads. Dry skin can cause scaly or aging skin.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}