{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"fc72a778-80bb-5793-8e27-422f8f3bac7a","task_key":"default--validation--41920","task_revision_id":"1","upstream_id":"41920","short_description":"HellaSwag validation 41920","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to make your nails grow in a week [title] Stop biting your nails! [substeps] This is extremely bad for them, and they will not grow add some onion (or another food you don't like) and chop it up. Then add it into a top or base coat bottle and apply it to your nails daily. This will make your nails taste bad, which will prevent you from biting them.\",\"endings\":\"['Another idea to be sure your nails grow in well are your toenails. Aim for a color that really stands out, then highlight where you want to really pop your toenails.', 'If you were starving yourself, you want to get a calcium rich diet, not dry or salty based. Enjoy your diet and eat everything! Make sure you eat healthy and using dry foods helps your nails grow.', 'You can also buy special products for this. Get a manicure, so you will not want to bite your nails and mess up the design and paint.', '[title] Paint the pads of your nails a color that makes you smile. [step] Do this before you have appointments and dinner (to cover up the fake blood).']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}