{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3214f54c-e0cc-52da-9ba7-2308898c7af9","task_key":"default--validation--24033","task_revision_id":"1","upstream_id":"24033","short_description":"HellaSwag validation 24033","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to do a baby model portfolio [title] Take the photos yourself. [step] There is no need to spend a fortune on having professional photos taken of your baby. Legitimate modeling agencies accept and encourage photos that you've taken yourself, since they know that babies grow and change all the time.\",\"endings\":\"['Just be sure that the photos are high-quality, have good lighting, and show your baby clearly. [substeps] Be sure to take the photos in color, not black and white.', \\\"But if you're really serious about developing a professional portfolio, consider taking a few professional photos of your baby model before moving on. This will allow you to tell them that your baby is a child and get their approval.\\\", 'However, if you don\\\\'t have them taken professionally, you may want to consider sending a \\\" mock shoot \\\" for a less costly portfolio. [substeps] A mock shoot is the formal, based upon your pregnancy and what your baby will look like.', 'However, by getting photos taken yourself, you will earn extra money. [title] Set up a page on your website.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}