{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2cccb21d-1eb2-5217-bb7a-3ae4b86a9256","task_key":"default--validation--5458","task_revision_id":"1","upstream_id":"5458","short_description":"HellaSwag validation 5458","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to lower your alimony payment [title] Read through your divorce decree. [step] Some divorce decrees include circumstances in which alimony automatically will be terminated or reduced. [substeps] If your decree includes such a clause and one of those circumstances has happened, your ex-spouse may be more amenable to the change.\",\"endings\":\"['[title] Look at your alimony settlement in which your child is awarded less alimony. [step] A settlement does not promise to lower the alimony, rather you may end up paying your award up front.', '[title] Notice that there may be limited activities. [step] There are many reasons you might choose to reduce alimony payments for which there is limited activity.', 'For example, your decree might specify that alimony payments will end if you lose your job. If you lose your job, the payments should automatically terminate according to the decree.', 'To find out if you should meet your alimony order, go to this article: http: // www.alimony-less.com/how-to-meet-your-alimony-order-by-default /. [title] Agree to lower your alimony payment.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}