{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c18bb02d-15fe-5001-b722-a74e639e8a00","task_key":"default--validation--30606","task_revision_id":"1","upstream_id":"30606","short_description":"HellaSwag validation 30606","config":"default","split":"validation","body":"{\"activity_label\":\"Youth\",\"ctx\":\"[header] How to have a cute and bubbly personality [title] Keep a positive worldview. [step] Being bubbly means developing a positive outlook to find the best in other people while lifting their spirits with your attitude. [substeps] Find ways to recast a negative situation in a positive light.\",\"endings\":\"[\\\"For example, try to remind yourself that something exciting was going on at work before a big event like a new job is coming up. Remind yourself that you can't move forward simply because something bad happened.\\\", \\\"For example, if your friend did something unfortunately that cannot change, you might get angry at her or remind yourself that it wasn't her fault or isn't important to her. Focus on the positives in things that do not happen everyday, and instead focus on things that make people laugh and high energy.\\\", 'For example, instead of thinking \\\" i\\\\'m so worried about finishing this essay, \\\" rephrase the thought as \\\" i\\\\'m so excited to write a great essay. \\\" practice finding positive aspects to daily life.', 'If you find yourself beating yourself up when you think the worst about yourself, start revisiting those circumstances, but then remind yourself that you are on your own, so you are not alone. Remember that for some people, having a positive outlook on life will make them happy.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}