{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"848e1e4b-874e-5d65-aef5-9483ba5a1818","task_key":"default--validation--27320","task_revision_id":"1","upstream_id":"27320","short_description":"HellaSwag validation 27320","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to choose a haircut for guys with thinning hair [title] Keep it short. [step] Generally speaking, the number one rule of dealing with thinning hair is to not let it get too long. This applies to men with both straight and curly hair, and anything in between.\",\"endings\":\"['Close-cropped cuts will give your hair a more uniform appearance and make inconsistencies in fullness less noticeable. [substeps] For most hairstyles, a length of about an inch or less will work best for minimizing the appearance of thin patches.', 'You need to give your head a trim regularly to maintain the slicked back look. [title] Rinse out your hair with cool water.', '[substeps] Long, messy waves can look good with simple hairstyles, but adding waves and tucking in ends can help you project the strength necessary to create the look you want. Stay away from drastic bobs, ponytails, or a rounded updo for men with thinning hair.', 'Give your hair a reason to grow out; girls love that! [title] Consider changing your hairstyle every two to three weeks. [step] Start with a bohemian style if you want to show off your straight hair.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}