{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c38a4b8f-a479-53a8-be9f-074d3c50924b","task_key":"default--validation--42446","task_revision_id":"1","upstream_id":"42446","short_description":"HellaSwag validation 42446","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to remove shellac nail polish [title] Apply cuticle oil to your cuticles. [step] Rub cuticle oil into the skin around your nails. Do not wipe away the excess.\",\"endings\":\"['Simply wipe out the excess oil with a cuticle pusher or cotton swab. Leave the oil to rest for 10 to 15 minutes.', 'Instead, wipe the oil off with a soft cloth. [substeps] This method is also known as priming.', 'Use a cotton swab to remove the cuticle oil. [substeps] Try painting your cuticles lightly with the cuticle oil to avoid abrasions to the skin on your nails.', '[substeps] Cuticle oil is a product designed to soften and moisturize your cuticles, and it can be found at any major drugstore. Applying it to your cuticles before removing the shellac nail polish will provide your skin with a protective layer against the harsh, drying acetone needed for this process.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}