{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7f7be26d-f47a-57d2-adee-cc6511040fe8","task_key":"default--validation--21331","task_revision_id":"1","upstream_id":"21331","short_description":"HellaSwag validation 21331","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to do chevron nails [title] Paint your nails. [step] You can paint your nails all one color or use a couple of different colors. Make sure that you let your nails dry all the way before you apply the tape strips.\",\"endings\":\"['Black will go good with the base to get the nail finish. Get down to the big pencil marks on your nails.', \\\"[substeps] If you are planning on painting your nails, then your waxer will need to work on your nails while you get them painted. You don't want to paint over and over on top of the paint, as this may damage the nail box.\\\", '[title] Dispense tape and cut into approximately 1 \\\" strips. [step] It is up to you if you want to cut enough tape strips to make a chevron design on each of your nails or just do a couple.', 'You can paint your nails one color, or you can also use several different colors to paint your nails from. [substeps] The french colour! The chevron is the most popular.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}