{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"32a42bea-7a27-50c4-9fe0-a1e9b31e47e1","task_key":"default--validation--9433","task_revision_id":"1","upstream_id":"9433","short_description":"HellaSwag validation 9433","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to use screen time to encourage physical play [title] Take advantage of breaks to play. [step] If you watch television as a family, make commercial breaks active time. Hold a contest to see who can do the most pushups or situps.\",\"endings\":\"['Many tv commercials will prohibit the continual use of screen time, and may lessen the number of pushups and situps involved. This will keep the audience engaged and enthusiastic, and everyone in their family will know when there is a 20 minute break.', 'Have special activities that you do as a family when breaks occur in screen time. [substeps] For example, have your children create a dance together or an art project during breaks, then show it off at the end of the show.', 'When the time comes, host a contest to see who will win. [title] Limit the periods of your \\\" alone time \\\" by fewer and fewer minutes.', \\\"A few daytime walks will put everyone in a good mood; a movie or afternoon session can increase or decrease the amount of time. [substeps] If you're watching different tv programs, you can also find temporary playing guidelines online.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}