{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"eb2f6d50-1f72-5190-bdd0-a596bc6b9e15","task_key":"default--validation--44711","task_revision_id":"1","upstream_id":"44711","short_description":"HellaSwag validation 44711","config":"default","split":"validation","body":"{\"activity_label\":\"Youth\",\"ctx\":\"[header] How to feel more attractive [title] Eliminate negative self-talk. [step] Do you find yourself being overly critical of every move you make? Replace critical thoughts with ones that reinforce a positive self-image. When you find yourself in the middle of a negative thought, stop the thought in its tracks.\",\"endings\":\"['To evaluate, objectively examine, and reevaluate a behavior you recently implement. Identify what you have been using to replace positive self-talk and add it to your list of negative attributes.', 'Instead, redirect the thought to the positive thought, \\\" i\\\\'m ugly! \\\" [substeps] Try to identify your negative thoughts using positive self-talk. Common negative statements can include, \\\" my appearance is a reflection of my intelligence \\\" and \\\" my feelings are not good.', 'Don\\\\'t think, for example, that your legs are fat and unattractive. Say to yourself instead, \\\" i appreciate my strong, muscular legs.', 'Fix the thinking with positive self-talk. [substeps] For example, instead of thinking, \\\" my best look is a little boring \\\" try to replace it with something like, \\\" this is my top that showcases my best features and has always been attractive, and that is your biggest weakness.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}