{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"633258e6-0897-5513-960e-874404fa26c5","task_key":"default--validation--37276","task_revision_id":"1","upstream_id":"37276","short_description":"HellaSwag validation 37276","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to make a brown sugar scrub [title] Fill a clean bowl with 1 cup (200 grams) of brown sugar. [step] Like other types of sugar, brown sugar makes an excellent exfoliant. Because the grains are so small, it is much gentler and perfect for sensitive skin types.\",\"endings\":\"['[title] Add ½ cup (120 milliliters) of a food-grade oil of your choice. [step] Almond, avocado, coconut, or olive oil all work great in sugar scrubs as they are all beneficial to the skin.', '[title] Add 1 teaspoon of the sugar to a small bowl. [step] Stir in enough to make a soft-ish scrub with no added drops of any essential essential oils.', 'Make sure you use rich brown sugar for your homemade scrub so you get the right type for your scrub. [substeps] Brown sugar is a natural exfoliant that you can use to treat your skin as well as covering blemishes.', '[substeps] Focus on picking brown sugar that is specifically formulated for sensitive skin. Like other types of sugar, brown sugar does not contain any additives.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}