Fetching details from the dictionary...

outsider; one not included in the favored group
outside daimyo; non-Tokugawa daimyo
外方の立場では幕府の要職に就けなかった。
Those in the position of outsider lords could not hold key posts in the shogunate.
外方の領地を治める役割を担った。
He took on the role of governing the outer domains.
薩摩藩は有力な外方として知られていた。
The Satsuma domain was known as a powerful tozama domain.