{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"854db0ff-c817-5f20-8e83-5fccab7ad324","task_key":"default--validation--16521","task_revision_id":"1","upstream_id":"16521","short_description":"HellaSwag validation 16521","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to look younger at 50 [title] Exercise. [step] Exercise is important at all ages, but it can be especially helpful once you reach your 50s. Include both cardiovascular and strength exercises in your routine.\",\"endings\":\"['[substeps] At least five days of exercise each week requires 30 minutes of moderate activity. [title] Come up with a form for your looks.', 'Great ways to exercise are by : [substeps] Doing cardio in the morning and at night. Not only will it help you get back into shape, but it will also make time to expend energy towards stretching on the weekends, or in the late evening.', 'Cardiovascular exercise gets your blood pumping and strength exercises can tone flabby skin associated with age. [substeps] Improved circulation supplies more nutrients and oxygen to your skin.', 'These will help you stay fit throughout the day and will provide enough energy to live your life. They can also help you find older body pictures of yourself and create a good as new body-image image! [substeps] Try to find a gym that has a bigger gym area than your home.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}