{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"da81d418-8e48-5464-afde-f37d02c6330e","task_key":"default--validation--39317","task_revision_id":"1","upstream_id":"39317","short_description":"HellaSwag validation 39317","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to get soft lips [title] Wear a moisturizing lip balm, as needed. [step] Use a balm with shea or cocoa butter for the best results. Reapply it only when your lips feel dry.\",\"endings\":\"['[title] Use lip balm with an alpha lip color. [step] Alpha lips make them look a little more natural, while the bold color creates a cute glow.', '[substeps] If you use lip balm too often, it can make your lips more chapped. Apply lip balm underneath any other lip products that you use, including lipstick, lip gloss, and lip stain.', 'You can apply a glossy lip balm to wet lips in the mornings, as it will help moisturize them even in the fall. If your lips are short and matte, seek a more lightweight, scented balm.', 'If you are looking for a more subtle trend, consider lip balm that contains shea shea or cocoa butter instead. [substeps] For a slightly softer look, use the tooth plumping formula instead of lip balm.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}