{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"57d8d396-fa65-5e01-8ba2-c52ff8bd0801","task_key":"default--validation--49978","task_revision_id":"1","upstream_id":"49978","short_description":"HellaSwag validation 49978","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to apply makeup for dark skin (girls ) [title] Use the right foundation for your skin type. [step] Different types of foundations work with different skin types, so decide whether your skin is more oily or dry before picking a foundation. If your face is always shiny, you breakout easily, and you tend to have larger pores, you probably have oily skin.\",\"endings\":\"['When choosing a foundation, pick a light foundation with a lighter shade of foundation. Again, if you have oily skin, skip the medium foundation and choose a foundation that is one shade lighter.', '[substeps] Broad spectrum foundation is a little more expensive than dry foundation, so narrow down your choices. Medium coverage foundation works best with oily skin and light coverage.', \\\"[substeps] For oily skin, choose a foundation that is labeled' hydrating' rather than' oily'. For dry skin, choose a foundation that says' hydrating' rather than' oily'.\\\", 'If your face has rough or red patches, barely visible pores, or flaking skin, you probably have dry skin. If your face has parts that seem oily and other parts that seem dry, you have combination skin.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}