This intersection is frustrating for everyone who passes through it.
Drivers hate it because left and right turning vehicles often jam up the whole intersection waiting for pedestrians to cross. Getting through this intersection, particularly going E/W, can often take 2-3 light cycles during peak periods - largely due to just a handful of turning cars blocked by oncoming traffic and/or pedestrians in the intersection.
Many pedestrians would like to make a "diagonal" cross in this intersection in one light cycle, rather than having to wait two light cycles to get where they are going. This likely contributes to the tendency of pedestrians at this intersection to attempt to cross against the signal (something that also makes driving through this intersection stressful). All-ways-cross is an arrangement that is so very underused in Seattle (It is only used near Pike Pl and in W Seattle) - this is an intersection that would clearly benefit - this would reduce pedestrian, vehicular and transit queuing and wait times as pedestrians and traffic would never be sharing the intersection.
This seems like it would really be a win-win-win arrangement.