{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7b0505e5-66f9-533f-851f-c82b56a4fc24","task_key":"default--validation--6053","task_revision_id":"1","upstream_id":"6053","short_description":"HellaSwag validation 6053","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to find the best person to get advice from on an issue [title] Ask someone you trust. [step] No matter what you need advice on, you should start by asking someone who you trust to give you sound advice. If the topic is sensitive, be sure to only ask for advice from people you know will not spread gossip.\",\"endings\":\"['[substeps] You should also make sure the person feels comfortable giving advice. Start with a very general description of your issue by saying something like, \\\" would you mind offering me some advice about how to choose a college major? \\\" or, \\\" i know you and your boyfriend have a great relationship.', \\\"Additionally, it's always better to be giving advice to someone you trust, rather than asking for advice solely from strangers or friends. [substeps] Ask someone whose opinion is important, such as a parent, guidance counselor, a trusted friend, or a trusted colleague.\\\", \\\"[substeps] Look for people who really care about you. Even if you're just meeting a stranger, this person might be willing to help you if you ask them to.\\\", '[title] Connect with others who are in a similar situation. [step] To help strengthen your friendship, build a support system with people who you feel you can depend on.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}