{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ed6bbbd2-2dd7-5da0-9461-c2acbcd82e21","task_key":"default--validation--43193","task_revision_id":"1","upstream_id":"43193","short_description":"HellaSwag validation 43193","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to choose a veil that matches with your wedding gown [title] Before shopping for a wedding veil it is essential to know whether you actually need it or not. [step] The beauty and need of a veil depends very much on the shape of the face of the person who would be wearing it. For instance, your shape could be either oval or round or oblong or heart or diamond or square and even rectangle and triangle.\",\"endings\":\"['While the first four shapes are soft and curved, the last four have more angular cuts. Remember that not every face shape needs a veil to highlight it.', '[substeps] Candle-holders, plate vases, bowls or heavy, made candles must not be attached to them. You can find wedding infant or baby candles in little boutique shops.', '[substeps] For crowns especially, choose a veil in a heart or square shape. A square veil helps to fill out large areas of your frame.', 'To help you determine what fit to your face best, ask a seamstress what style would best suit your face. [title] Your veil should be free of layers.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}