{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"faf30112-bbf3-56df-b597-a873b4a896e3","task_key":"default--validation--32252","task_revision_id":"1","upstream_id":"32252","short_description":"HellaSwag validation 32252","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to make a faux bob [title] Wash your hair. [step] Rinse your hair in warm water. This will open up the cuticles and make it easier to remove the oil on your scalp.\",\"endings\":\"['Use a loofah, wand, or your fingers to gently detangle your hair. If you have thick hair, you may be able to work from part to part without any pulling.', \\\"You can also give your hair a shower to get rid of excess oil. [substeps] You don't need to shampoo or condition your hair at all.\\\", 'Apply a quarter-sized amount of shampoo to your scalp. Use your fingers to bring the product to a lather.', 'Make sure to sit under the faucet, where water does not pool. [substeps] Rinse your hair under cool to lukewarm water for 30 seconds and then rinse.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}