{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"eb6507f5-27ec-5d8c-8433-c84c67dbf2ce","task_key":"default--validation--7873","task_revision_id":"1","upstream_id":"7873","short_description":"HellaSwag validation 7873","config":"default","split":"validation","body":"{\"activity_label\":\"Education and Communications\",\"ctx\":\"[header] How to draw manga styled girls [title] Do a short curved line then continue from that to make a smooth bump for the cheek. [step] Then curve from that line to the opposite side for the jaw bone. Make two parallel lines at the beginning of the jaw bone and curve them at the bottom.\",\"endings\":\"[\\\"Continue with the line for the bottom of the mouth, smooth them and the chin bone very well. Tip the chin downwards about 15 degrees and you should have the letter' t' shape.\\\", 'After that, follow the line using how long it is the head. Do the curve if it is too long (and the curve if it is too short).', '[title] Optional : [step] Do a backwards c hover over the jaw bone. Connect the ends with a squiggly line , [title] Make a curved line from the side with the cheek and stop before you reach the jaw bone.', '[title] Add another curve and use two slightly curved lines for the eyes. [step] Make the first curve curved so that it shows under the eye.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}