{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0817df22-e38c-5b9b-b66a-b87408f62804","task_key":"default--validation--3609","task_revision_id":"1","upstream_id":"3609","short_description":"HellaSwag validation 3609","config":"default","split":"validation","body":"{\"activity_label\":\"Education and Communications\",\"ctx\":\"[header] How to write a personal statement for law school [title] Give yourself enough time. [step] One of the biggest mistakes that you can make with regards to your personal statement is not allowing yourself enough time to brainstorm, write, rewrite and edit. It is recommended that you allow yourself at least four to eight weeks to complete your personal statement.\",\"endings\":\"['You should ask yourself how often you plan on writing in the future. Under any circumstances, the best time to start is right after graduating from law school.', 'To ensure that you get enough time to write an effective statement and to reflect on what you were thinking and feeling the whole time, you should be considering a full-length essay. [title] Break your personal statement into several pages.', 'Therefore, as soon as you notice that your schedule has become limited, set aside the time to brainstorm and revise your personal statement. [substeps] Think back over your personal statement and consider the ways it could be improved.', '[substeps] If you know that writing is particularly difficult for you, consider giving yourself 10 to 12 weeks to work on your statement. Start the process as soon as possible so as to give yourself enough time to take a break from writing and editing.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}