{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9daf90f2-3c7b-5292-a184-827663469bf4","task_key":"default--validation--27213","task_revision_id":"1","upstream_id":"27213","short_description":"HellaSwag validation 27213","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to apply aftershave splash [title] Rinse your face with cold water immediately after shaving. [step] Before you even consider applying aftershave, you want to make sure your face is completely free of shaving cream or leftover hairs. Fill your cupped hands with cold water and rub it thoroughly over the entire area that you shaved.\",\"endings\":\"['[substeps] Warm water will slow down the process. You should also add a splash of aftershave spray to your water to keep your shaving chemicals from absorbing into your skin.', 'Your freshly shaved face should be completely covered and clear of hard-to-see hairs. [title] Store shaving cream in the refrigerator.', \\\"The benefit of cold water is that it closes the pores of your skin which is best for aftershave application. Be gentle as your rub your face so you don't chafe or irritate the skin.\\\", 'By rinsing thoroughly, you can ensure that each piece of stubble is covered completely. [substeps] If you use a soap, do so in a quiet, secure place.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}