{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"88f6b52d-dedd-5084-9ab5-b00727cc96a5","task_key":"default--validation--45634","task_revision_id":"1","upstream_id":"45634","short_description":"HellaSwag validation 45634","config":"default","split":"validation","body":"{\"activity_label\":\"Relationships\",\"ctx\":\"[header] How to avoid being in a relationship [title] Be honest about your intentions. [step] If you want to date casually, make sure your new fling knows that you're not looking for anything serious. Being honest about what you want will give you the opportunity to have some fun and date around without hurting anybody's feelings.\",\"endings\":\"['Though a casual fling might be fun in nature, the abrupt end of a relationship can make it hard to move on. [substeps] Tell your current fling you are not looking for sex.', '[substeps] Be as specific as possible in what you want out of a relationship before planning to put it on your own. For example, you could say, \\\" i am purely interested in a casual relationship, but i\\\\'m thinking about moving in with someone outside the friend zone.', \\\"It will also eliminate the possibility of getting locked into a relationship that you don't want. [substeps] Establish whether you want to be exclusive or non-exclusive with somebody you're dating.\\\", \\\"[substeps] Resist the urge to tell your potential fling that you're not interested in one another. Lying to your potential fling regarding your intentions will hurt your chances of getting that person to trust you.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}