{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d44c3973-04f9-5aad-b791-ed4cb9d76078","task_key":"default--validation--27953","task_revision_id":"1","upstream_id":"27953","short_description":"HellaSwag validation 27953","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to use manicure tools [title] Soften cuticles with cuticle remover or softener. [step] Before you use a cuticle pusher or nippers, it is important to use a cuticle softener or remover. This will make it easier to push back the cuticles and also to remove any excess skin with the nippers.\",\"endings\":\"['After cuticles are soft, you can begin to apply cuticle pushers. [substeps] Try using a cuticle pusher, which is similar to a manicure tool except its pointed end closer to the rest of the tool.', '[substeps] Try soaking nails in a solution of warm water with a few drops of hand soap in it. Let the nails soak for about five minutes.', '[substeps] This will also remove any moles that remain in the winter. [title] Apply long, even strokes across your cuticles.', '[substeps] Gently dampen your cuticles with a moistened pat of petroleum jelly. Wear gloves while you apply the moisturizer.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}