{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"df7418ec-6b58-55a9-a496-9bee05877907","task_key":"default--validation--21340","task_revision_id":"1","upstream_id":"21340","short_description":"HellaSwag validation 21340","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to get long nails [title] File in one direction. [step] Filing your nails in a back and forth motion can create tiny tears in the nail and this may lead to breakage. To prevent this from happening, make sure that you file your nails in one direction only.\",\"endings\":\"['If your nail surface is ice or textured, then file from the inside of the nail. To avoid damaging the nail, hold your file 1-2 inches from the surface, and only file only the outer edge.', '[substeps] Apply gentle pressure to your nail with the file. Then, move the file in one direction.', \\\"When filing, make sure you're filing from one side of the nail upwards rather than from the other side. [title] Use a cuticle pusher to file away any rough patches.\\\", 'Use a fine-grit brush or the flat side of a nail file, then gently file the edges to create long nails. [substeps] If you prefer, you can create your nails in an l shape using a french manicure-style file.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}