{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f179bce7-345d-5b84-8566-f4251de3bab6","task_key":"default--validation--30191","task_revision_id":"1","upstream_id":"30191","short_description":"HellaSwag validation 30191","config":"default","split":"validation","body":"{\"activity_label\":\"Food and Entertaining\",\"ctx\":\"[header] How to look like kourtney kardashian [title] Start with deep cleaning. [step] Kardashian believes in deep cleaning her face every day. Pick something that's right for your skin type, and use it before you go to sleep every night.\",\"endings\":\"[\\\"[substeps] Cleansers come in a variety of types, for everything from oily to dry skin. The bottle will say what type of skin it's appropriate for.\\\", \\\"Kourtney prefers regular cleanings from her make up artist, makeup artist or groomer. It's a good idea to use at least twice daily.\\\", \\\"For example, use a rounded head brush in a shower bottle with plenty of suds for oily skin, or focus on cleansers made specifically for oily skin. However, aim for cleansers that contain spf, and don't leave residue behind.\\\", \\\"[title] When you wake up, put on your makeup. [step] Consider getting some so you know what you're doing.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}