{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7c37da07-35a7-5a32-a510-b5c44d3309b2","task_key":"default--validation--28308","task_revision_id":"1","upstream_id":"28308","short_description":"HellaSwag validation 28308","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to follow a custom skin care regime [title] Select a combination of botanical and oils to complement your skin care regime. [step] A blend of lavender, german chamomile, frank incense, wheat germ, grape seed, jojoba and olive oils can create an effective skin care for your face. It will reduce and prevent wrinkles.\",\"endings\":\"['Remember that beauty is created by all human beings and that we are all human. If you opt for a botanical or olive oil, remember that it will nourish it.', \\\"For light to moderate coverage use : [substeps] Pick a shade where you can clearly see the entirety of your face except for your forehead. Wear a stronger tool when you're purifying your skin.\\\", 'You can too use such oils as a body oils or lotions. The best aspect about such skin care products is that you obtain to customize it just for your purpose.', 'Winter and cold can dehydrate and dry your skin, and you can probably mimic this by mixing herbs and spices. [substeps] Consider creating an herbal scrub using lemon, mint and olive oil, such as lemon balm.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}