{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5c5b0470-e555-58ef-909f-d356481db078","task_key":"default--validation--3710","task_revision_id":"1","upstream_id":"3710","short_description":"HellaSwag validation 3710","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to be assertive without being aggressive [title] Take a deep breath and smile. [step] By taking a moment to breathe and smile you not only prevent yourself from acting rashly and aggressively, but you release endorphins in your brain. [substeps] Endorphins are released when you smile because your brain has been trained to recognize these muscle movements as positive.\",\"endings\":\"['If you feel yourself overconfident, relax and focus on projecting confidence. Relaxing mentally and physically can also help prevent you from becoming angry or frustrated.', 'Endorphins, along with serotonin keep your mood up and stable. Breathing and smiling also relieves stress because it lowers cortisol levels, which is a stress hormone.', 'In other words, your stomach should double the number of positive, calming endorphins that are in your body. This should get your mind off the tension of anxiety, which is common in human behavioral patterns.', 'Red hair is the type that goes dormant at the base of your brain which can lead to a decrease in emotion. Both feelings are very normal, but red hair helps eliminate any negative emotions that may reconstitute later in life.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}