@SANNA
For the Northern wall, the azaleas might do better than at the Southern wall area.
Might I suggest for your Southern wall, plants that bloom during the summer and tolerate sun such as glossy abelia, dwarf fothergilla (a shrub that blooms in the spring) with bottlebrush white blooms and in the fall before the leaves fall off turn red, orange and yellow? An early summer blooming shrub is weigela and there are many now that have smaller size (between 4 - 2') instead of 10' like our parents/grandparents had. Plus those tubular blooms are now in pink or reddish shades.
I can suggest daylilies on the Southern area that bloom in the summer (numerous colors and sizes) I recommend the Tetraploid types as their colors are deeper and sharper and they are sturdier than the Diploid ones. On mailorder descriptions you will see a T vs. D in the details.When you look at the photos of the two types, you will see what I mean re: colors.
Southern wall might like peonies which are fall planted and spring blooming (many are fragrant).
For Northern wall I can suggest mountain laurels (many are now 4' maturity instead of 10' like our parents/grandparents had and come in pinks, reds and whites). Rhododendrons are another choice and you can mix in shade loving perennials such as astilbe, hostas, heucheras, tiarellas, dicentra exima (summer blooming bleeding hearts) to keep the show going once the spring blooming plants are done. Low growing ornamental grasses such as Carex morrowii, Hakone grass, or various Sedges can add green interest or variegated interest as well.
One of the last blooming perennials in the late summer into early fall are Tricyrtis hirta a non spreading vs. clumping toad lily. I have 'Togen' in my garden mixed with Hakone grass 'Naomi' and it gives a Zen feel to the area.These are filtered shade loving perennials.
☼The best place to seek God is in a garden. You can dig for him there. GBShaw☼