{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"93771281-0ba5-5a92-a4d6-1aea27191e1b","task_key":"default--validation--29328","task_revision_id":"1","upstream_id":"29328","short_description":"HellaSwag validation 29328","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to get off federal probation early [title] Fulfill all conditions of your supervised release. [step] To be eligible for early termination, you must obey all the terms and conditions of your probation from the moment it begins without any violations or issues. [substeps] Some violations, such as possession of a firearm or a controlled substance, require the mandatory revocation of your supervised release and return to prison.\",\"endings\":\"['Typically, to have your request for early termination of your supervised release approved, you must be doing exceptionally well on probation and not be causing any problems or concerns for your probation officer. [title] Complete at least one year of supervised release.', 'Failure to satisfy these conditions can result in an early termination of your supervised release. Failure to fulfill those conditions could result in your probation going off in two years.', 'If you are given additional notice, that notice will automatically expire. [title] Go to the disciplinary office at your county courthouse.', 'An example of a violation of your supervised release includes chewing tobacco in bars and having a habit of smoking, drinking, and using illegal tobacco products. You must fulfill all conditions of your supervised release and return to prison and your home free of charge.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}