{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"55f097c4-49f5-5359-9b46-caeaae57d011","task_key":"default--validation--24518","task_revision_id":"1","upstream_id":"24518","short_description":"HellaSwag validation 24518","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to reject a marriage proposal [title] Be clear on why you do not want to get married. [step] It is perfectly ok to have a \\\" gut feeling \\\" that the marriage would not be successful and simply go on that. However, it is even better to be clear to yourself what your concerns are.\",\"endings\":\"[\\\"If you're simply nervous about making such a big commitment (which is not uncommon) try reading the advice in. If you're concerned that you and your mate are not compatible in some way, it's important to address your worries as soon as possible, long before your partner gets down on their knee.\\\", \\\"Are you absolutely sure marriage is a good idea? [substeps] Do you want a serious, blind relationship with no doubt been agreed upon? If so, perhaps the marriage is not what it's supposed to be. After all, there is no reason why you shouldn't focus on your wants and needs.\\\", 'Think about why your feelings are irrational and why you think the marriage would work out. Think on these concerns in advance, such as a problem that needs to be resolved, fear of rejection might be standing in the way of the proposal progressing towards an outcome that is undesired.', 'A feeling as ambiguous as \\\" i can\\\\'t do this \\\" is generally a sign that an engagement could not work out. A valid reason would be because you are in love and do not want to be tied to someone else.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}