{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"be64a9b2-05ba-5313-9fcd-9ed0acbc22c9","task_key":"default--validation--24914","task_revision_id":"1","upstream_id":"24914","short_description":"HellaSwag validation 24914","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to manscape [title] Take a shower to clean your body of any dirt and oil that may be trapped in your pores. [step] Having clean skin can help produce better manscaping results, especially if you plan on using a razor. [title] Trim your armpit hairs using clippers or an electric trimmer.\",\"endings\":\"[\\\"[step] Manscaping can develop scar tissue that is difficult to heal, so be sure to trim the hairs when you get the chance. Don't cut your armpit hair unless you are totally sure that the hardened area has healed.\\\", '[step] Normal trimmers cut your armpit hairs back to the height that they were raised, which is roughly the middle. Starting with your upper body, trim as you would a regular trimmer.', '[step] These razors put all of the body hair in one place, for example, the upper armpit. [title] Start shaving from the outside of your armpit out towards the bottom of your chest.', '[step] The length of your armpit hair should be short enough to be manageable, and should not be visible or sticking out when your arms are at your sides. [title] Trim a hairy chest using an electric trimmer.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}