{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"43454ebf-af51-5192-adef-bf590140c2f5","task_key":"default--validation--46923","task_revision_id":"1","upstream_id":"46923","short_description":"HellaSwag validation 46923","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to choose a colorful wedding dress [title] Try blush. [step] A light pink or peach blush shade can be great to add a subtle splash of color to your wedding day. A blush tone is flattering on most skin tones and works great for a light color that does not stray too far from the traditional white.\",\"endings\":\"['However, be sure you are very subtle when you are walking down the aisle. This way, you are sure that your partner and fellow bridesmaids will be able to tell that you are blushing.', '[substeps] A blush tone gives off a somewhat dreamy look. It can go well with a romantic, fairy tale-like wedding theme.', 'You can also try blush shades that are earth toned. This color may or may not work well for a wedding wedding where pale pinks and deep purples draw the eye.', 'Work out what shade of blush suits the color of your dress, and find a shade that closely matches the dress. You might have to experiment slightly to get a dark enough shade.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}