{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a19f247f-cbaa-5c76-b308-f0892fa1285f","task_key":"default--validation--4311","task_revision_id":"1","upstream_id":"4311","short_description":"HellaSwag validation 4311","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to dress when you are in your forties [title] Get your clothes tailored. [step] Most people can't afford to buy clothes made to their specifications. However, getting less expensive clothes tailored can make all the difference in how they look.\",\"endings\":\"['[substeps] For example, go for a fitted, long-sleeved or sleeveless top that emphasizes your body. Depending on where you are in your thirties, you might also consider wearing pants that are fitted.', \\\"If your clothes are form-fitting, you're going to look that much more pulled together. When in your 40s, being able to pull together a professional look is a must.\\\", \\\"[substeps] The general rule is to get your clothing tailored to fit every body type. The first thing to check out is how well you'd like to wear them, have the clothes tailored to fit each body type, and how well you'd like to use them in your life.\\\", '[substeps] Professional tailor tailors are knowledgeable about tailored clothes for almost every gender. Ask colleagues, friends, or coworkers about the exact fit of an outfit they would suggest you get.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}