{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"77843e52-e698-533e-a40e-ad5de90e3627","task_key":"default--validation--36991","task_revision_id":"1","upstream_id":"36991","short_description":"HellaSwag validation 36991","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to do ombre nails [title] Clean up your nails. [step] Use a cotton ball lightly soaked in nail polish remover to remove any nail polish currently on your nails. Gently trim your nails with nail clippers until your nails are at your desired length.\",\"endings\":\"['[title] Apply a base coat to ensure that the polish is not too thick or crumbly. [step] Start by applying a clear base coat to your nails (no black) using a cotton ball.', '[substeps] Be sure to trim the tips of your nails so they are at least an inch (2.5 cm) long. [title] Polish your cuticles with buffing powder and fabric polish.', 'Then use a nail file to smooth out rough edges and shape your nails. [substeps] You can also push back your cuticles using a rounded manicure stick.', \\\"[substeps] Don't hold your nail back as you trim. Hold it in with your dominant hand, your other hand holding your cuticle (the part of your nail you want to add nail polish to).\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}