{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5c42b5bf-6732-5cc3-8c7b-04640f96c3a1","task_key":"default--validation--38179","task_revision_id":"1","upstream_id":"38179","short_description":"HellaSwag validation 38179","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to make your lips naturally red [title] Use a natural lip scrub. [step] The first step to getting red lips is getting rid of dry, flaky skin that builds up and hides their natural color. Sloughing away the dead skin brightens your lips, brings out their inner red color and prepares them to take on a stain.\",\"endings\":\"['[substeps] Avoid lip scrub made with salt, baking soda, and alcohol to remove dry, flaky skin. If you like something sweet, add a bit of sweetness with your preferred lip scrub.', \\\"You'll need an oil-free lip scrub that is formulated for wet lips. [substeps] Pour ½ teaspoon coconut oil into a small bowl.\\\", \\\"Here's how to make and use your own scrub : [substeps] Mix 1 teaspoon honey and 1 teaspoon brown sugar. Scrub the mixture into your lips in a circular motion.\\\", 'Choose a thick balm or a facial scrub that makes your lips even more natural. [substeps] You can purchase lip balm over the counter at any pharmacy or beauty supply store.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}