{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c934cb27-e177-5830-920b-859459592ce9","task_key":"default--validation--24085--variant-29c107ddffff","task_revision_id":"1","upstream_id":"24085--variant-29c107ddffff","short_description":"HellaSwag validation 24085","config":"default","split":"validation","body":"{\"activity_label\":\"Youth\",\"ctx\":\"[header] How to make money as an elementary school student [title] Ask for an allowance. [step] Many children earn a weekly allowance. This allowance is to pay for everyday things like buying food or going out with friends.\",\"endings\":\"[\\\"It might be nice to extend it on a regular basis. The amount you earn per week doesn't necessarily have to be that huge depending on the age of the child and its needs.\\\", \\\"Ask the teacher if they have a reasonable allowance you can take advantage of. If you don't receive one, ask if you can limit your allowance to how much you can earn.\\\", \\\"Having an allowance can help you manage your money well-even if you don't have an allowance. [title] Teach your children about the value of money and the benefits of work.\\\", \\\"If you don't already earn an allowance, ask you parents if they would be willing to start giving you an allowance. [title] Ask for a raise in your allowance.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}