{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0e934b3b-713f-535b-9373-467782190dfd","task_key":"default--validation--24262","task_revision_id":"1","upstream_id":"24262","short_description":"HellaSwag validation 24262","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to make professional looking ripped jeans [title] Research different ripped jeans styles. [step] Look online and in fashion magazines for distressed jeans. Find out what kind of a ripped jeans style you want to create.\",\"endings\":\"['This can influence the feel of your jeans. [substeps] The fit of distressed jeans fit your body and adds some volume to your look.', 'Then consider what effect your ripped jeans are on the body and the other components of your wardrobe. [substeps] For example, if you want a more edgy look, look for jeans that are leg skinny or form fitting.', \\\"It's not a great idea to try to stop a style that doesn't seem to attract your eye. [title] Find out about the issue of ripped jeans.\\\", '[substeps] Pay attention to how many rips jeans have and where those are. Two or three tears are usually sufficient and not overdone, but you should pick what looks most appealing to you.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}