{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d913c306-0f22-53cd-a5c4-2c2c74e68a6f","task_key":"default--validation--16278","task_revision_id":"1","upstream_id":"16278","short_description":"HellaSwag validation 16278","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to dress effectively [title] Accept yourself : [step] You need to accept your flaws with your good points, only then can you camouflage your flaws and highlight your strong points. For example: if you have a great shoulders but a bottom that you prefer to play down, you can highlight your beautiful shoulders by wearing strappy tops or off the shoulder items and cover your bottom with shaping underwear and a loose skirt. [title] Use the magic of color.\",\"endings\":\"[\\\"[step] As a writer, think of a color that complements all of your character's features, not just your clothes. This is the first step to reducing your flaws.\\\", '[step] Though you may still over dress yourself, using a color scheme has benefits. You can also wear similar bottoms and tops to have someone bring out your uniqueness without revealing your weaknesses.', '[step] If you want to look like grace sander or shirley temple, you can go for shades of every color. Shades include yellow, green, purple and pink.', '[step] Color plays a very important role in reflecting your personality. Warm and bright hues may make you look wider; dark colour can make you appear leaner.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}