{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8a7b996e-87f3-50d6-a641-82bb0c45c486","task_key":"default--validation--6436--variant-f2e7f6a6e87c","task_revision_id":"1","upstream_id":"6436--variant-f2e7f6a6e87c","short_description":"HellaSwag validation 6436","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to grow sideburns [title] Grow your facial hair for at least 4 weeks. [step] Your facial hair will need to be about an inch long to sport full sideburns. If you want bushier sideburns, then you may need to grow your hair even longer.\",\"endings\":\"[\\\"Keeping your facial hair short will make sure that you don't give it too much shape. [substeps] Even if the hair on your face is lighter, it won't grow in very well.\\\", 'Tell your barber about how long your facial hair will grow over time so that they can tell you how long it will take to grow them. [substeps] When growing your facial hair, get your barber to cut the ends of your facial hair to prevent this from happening.', \\\"Everyone's facial hair grows at a different pace, so it may take longer for yours to grow to the right length for sideburns. [substeps] Try growing your hair into a beard first to get the length and then you can shave the facial hair into sideburns later.\\\", 'Mature faces look just like they do, and shaving is a great way to do that. [substeps] While much of the skin that eventually displays sideburns is grown out of your facial hair, you may need to keep you facial hair very short.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}