{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d4a29ccb-380f-5784-803d-cfb258b524ce","task_key":"default--validation--23106","task_revision_id":"1","upstream_id":"23106","short_description":"HellaSwag validation 23106","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to lighten dark lips [title] Moisturize your lips. [step] Dry, damaged lips can have a dark appearance. Use a good quality lip balm.\",\"endings\":\"['And also try some milk or water to hydrate your lips. Also try leaving it in your mouth for up to 3 to 7 days.', 'Check the ingredients to make sure that it has both a moisturizer, such as shea butter or cocoa butter, and a binding agent, such as beeswax. [substeps] Good moisturizing ingredients to look for include shea butter, cocoa butter, and almond oil.', 'Use around 70 percent of your regular lip (lip) keep it moisturized for dry lips or check out other lip products for special occasions. Choose a lip balm that is tinted with natural oils or fragrance.', 'Lip balm is a great glowing lip balm that will smooth out your lips and make them glow. It stays in your lips for a fair amount of time and helps to plump your lips without drying them out.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}