{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d4250b0b-41e6-51b2-948f-b436fe70522a","task_key":"default--validation--36540","task_revision_id":"1","upstream_id":"36540","short_description":"HellaSwag validation 36540","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to know skin types [title] Notice dry patches. [step] You may have dry skin in some places if it is red, wrinkly, dull, and rough. If you have dry skin, you will probably not be able to see your pores in that area.\",\"endings\":\"['Contact your doctor if these patches indicate they are dry. [substeps] Avoid wearing glasses or contacts if you have dry skin.', 'It may even look scaly or itch. If your skin is vulnerable to drying, you can protect it by : [substeps] Avoiding long, hot showers.', 'Oily skin, in particular, tends to be dry and flaky. Oily skin is usually washed more often and may stain objects like paintings and shelves, particularly portraits.', 'If this occurs you can make a skin test : [substeps] Smooth the patches with a pad of damp cotton wool or the dry patches of face washing. If they rub, they might be greasy.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}