{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"14faacca-ab08-57a2-9a11-aae41357fe7f","task_key":"default--validation--22913--variant-ad663316f777","task_revision_id":"1","upstream_id":"22913--variant-ad663316f777","short_description":"HellaSwag validation 22913","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to make liquid foundation [title] Find a small container to use as a mixing palette. [step] Facial moisturizer is formulated to be gentle on your face. Don't use body lotion or anything other than your facial moisturizer for this or you may end up with clogged pores and breakouts.\",\"endings\":\"['Ensure that you use a liquid foundation that is either thinner or thicker. This will keep any product that you use from getting into your pores while you are in the bath or shower.', '[substeps] The ideal container is a matchbox or a box or a wooden bowl to use as a mixing palette. A bowl made from scratch will work fine.', \\\"If you don't want to use a container, you can use a mixing palette. The container could come with an air-tight lid or a separator (solid gold or opaque) and a brush icon to add texture.\\\", \\\"[substeps] If you break out easily, use an oil-free moisturizer. If your favorite facial moisturizer has sunscreen already included in the formula, that's even better! [title] Sprinkle your powder foundation into the container.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}