{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4ed83012-69d2-5b8a-af23-cd2669461de4","task_key":"default--validation--48111","task_revision_id":"1","upstream_id":"48111","short_description":"HellaSwag validation 48111","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to get great lips [title] Use a lip scrub to exfoliate your lips. [step] The skin on your lips is delicate, and it easily dries and begins to flake. If you have dry, cracked lips, you need to condition your lips instead of trying to cover them up.\",\"endings\":\"[\\\"You can use a lip scrub made with honey, olay, or vitamin e in place of the regular lip scrub at home, or from the grocery store. [substeps] You don't need to apply it overnight, though.\\\", 'Get a lip scrub specifically made for lips, or mix up a batch of peanut butter and honey with a few drops of red food coloring and a dash of essential oils. [substeps] Cover your lips with a clean washcloth before applying the lip scrub.', 'Apply a lip scrub just as you would your face. Stick with the first two to three times daily for best results.', \\\"A light lip scrub can do the trick in a matter of minutes. There's no need to buy a special scrub, just mix one up at home.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}