{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ee7f162d-41d5-5042-8421-e325f57d4194","task_key":"default--validation--9748","task_revision_id":"1","upstream_id":"9748","short_description":"HellaSwag validation 9748","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to crochet boot cuffs [title] Create a foundation chain. [step] Attach your yarn to the crochet hook using a slipknot, then work 35 chain stitches to create a foundation. [substeps] This part will circle your leg, so you can determine whether you need a larger or smaller chain by wrapping it around your calf.\",\"endings\":\"['For a sturdier knit chain, only go to 100 chain stitches for a large cuff. Adding 30 loops to yarn in the foundation chain will allow the foundation to slip more easily over the hook.', 'To create a foundation chain, place a foundation square onto the knitting board and round the edge with your hands. Then loop this yarn over the back of the previous row and round to the front of the board using a slipknot.', '[title] Make a chain of 12 chain stitches. [step] Begin by wrapping all the way around your leg, then lightly drop the yarn into place where you want it to end.', 'Since the yarn will stretch as you work, though, your chain should have about 10 fewer stitches than you think you will need for the two ends to meet. If you do not know how to make a slipknot or chain stitch, check the \\\" tips \\\" section of this article.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}