{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ec19aa92-9bc6-5b43-8f9d-a2c9dfc3a67b","task_key":"default--validation--22956","task_revision_id":"1","upstream_id":"22956","short_description":"HellaSwag validation 22956","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to make your butt look sexy [title] Build up your leg and butt muscles. [step] The best way to give yourself a sexy butt is to build a sexy butt. This takes a lot of time.\",\"endings\":\"[\\\"Once you start lifting, you won't see a noticeable difference for 3 weeks. Other people won't start to notice until 6 weeks into working out.\\\", 'To build up muscles, try : [substeps] Jog on the treadmill. As soon as you get home from school, run your whole workout on the treadmill for thirty minutes to two hours.', \\\"It's much better to build up your legs than to build them up over time. In fact, building up your leg and butt muscles will slow down your metabolism and help your body become healthier.\\\", 'For example, you might be able to build up a little thigh muscle, leg, and shoulder muscles in only a few days. You can work on building up your butt while doing leg work.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}