{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f3b5fc53-ced4-5d4d-8427-c1f906a10938","task_key":"default--validation--47797","task_revision_id":"1","upstream_id":"47797","short_description":"HellaSwag validation 47797","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to get a tebori tattoo [title] Search online for tebori tattoo artists. [step] The internet will be your best resource for finding and reaching out to tebori parlors. Search for tebori-specific tattoo artists.\",\"endings\":\"['Some tattoo artists only specialize in tattoo businesses, such as the grass tattoo studio, ufc brand, or goodness. Consider websites like shearer and serious studios.', 'For example, a tattoo parlor called honey tattoo in the ikebukuro district of tokyo provides tebori tattoos. [substeps] Tebori tattoo parlors that are more traditional or located farther from urban centers (like tokyo) may be unwilling to respond to inquiries made in english.', 'Some parlors do their tattoo curing for free, while others charge a fee for the process. Make sure the artists are licensed, credentials are kept, and mentioned on their websites.', 'Do some research and submit what looks good at first out of sight. [title] Be prepared to pay a relatively small fee to purchase an inked tattoo.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}