{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c83b04ea-17d7-540e-8bb1-dc2c3629d195","task_key":"default--validation--30241","task_revision_id":"1","upstream_id":"30241","short_description":"HellaSwag validation 30241","config":"default","split":"validation","body":"{\"activity_label\":\"Computers and Electronics\",\"ctx\":\"[header] How to discipline a teenager [title] Make your expectations clear. [step] One of the keys to having a positive relationship with your teen is good communication. You need to be able to talk to one other and make your feelings and desires clear.\",\"endings\":\"['If you are able to communicate effectively, you might find that you need to discipline your teen less frequently. An important component of good communication is a clear explanation of your expectations.', 'Otherwise your student may interpret other actions as negativity. [substeps] Have a conversation about what you expect and encourage that student to behave.', \\\"[substeps] Be direct if you want your teen to listen to you. Be sure you aren't sounding overly emotional or that your wishes and desires are being communicated to the teen.\\\", \\\"Your teen's sense of self-control will predispose them to bad behavior and you need to set some clear standards. Some things to consider and remember when you are disciplining your teen are : [substeps] The quality of your communications with your teen about what their actions do or do not warrant you disciplining them.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}