{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"151ca33d-f172-5382-be62-bbb637ae8191","task_key":"default--validation--9296","task_revision_id":"1","upstream_id":"9296","short_description":"HellaSwag validation 9296","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to raise body positive kids [title] Be a role model. [step] Whether they show it or not, your children watch and mimic you. Set a good example by valuing healthy foods, exercise, and a positive attitude toward your body.\",\"endings\":\"[\\\"The children will follow your lead if you stick to the diet and lifestyle goals associated with raising your child. If you have a glass of milk before a meal instead of everyone's, lift both eyebrows.\\\", 'This will help the children see a positive side of you and lead them to believe in you. [substeps] Be consistent with your routines and practice active listening.', \\\"If you're trying to lose weight, don't obsess about it in front of your child. Instead, stress the importance of being healthy and physically fit.\\\", '[substeps] Have a positive outlook on life and motivate your kids to emulate you. Wash their clothes regularly, stay clean, and take care of them.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}