{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ba1c9ee1-367a-5ddd-b16e-178e46813032","task_key":"default--validation--40143","task_revision_id":"1","upstream_id":"40143","short_description":"HellaSwag validation 40143","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to style a beard [title] Let your beard grow to the desired size. [step] Before you can style a beard, you have to give it time to grow. Leave it alone.\",\"endings\":\"[\\\"Seriously, no trimming or shaving for at least a couple of weeks. It'll look messy, but remember that your beard won't look the same when it reaches full length.\\\", 'If it grows to the point where it is pulling at your facial hair, you should stop it right away. Instead, leave it to grow, for up to a week.', 'Ideally, after it has grown a bit longer at this stage, it should be between 1/8 inch and 1/4 inch. Any rough patches that appear should be cut away and left alone.', 'Try to gauge the length of the beard and areas that will need the most time to grow longer or shorter. Try to get a beard size between 11 to 18 inches (24.4 to 30.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}