From a design perspective I’d probably start off with a couple of small shrubs on either side of the steps that are either evergreen or have year-round interest. If you go with native plants, you could check out inkberry holly (need male & female plants to get fruit) or catawba rhododendron. I’m sure there are other great options, but I’m not from the area and just recognized those two from my region. For non-natives, cryptomeria globosa nana or gold mop cypress might fit well.
Beyond that, I’d find a good local nursery and tell them how much space you have to fill and load up with perennials. My personal preference would be to focus on creating a butterfly/hummingbird garden. Just buy 2-3 of everything and plant them in little groups using the recommended spacing as a guide. Then, load mulch between all of the plants and wait for it to fill in over the next 2-3 years. I like bark mulch, but currently use pine straw (that’s the big thing here in the south); I despise rock mulch.
Another option is to get a seed mix from a place like prairemoon.com and just spread it and let nature take its course. It will take longer, but save you time and money compared to buying and planting individual plants.
From there you can just keep going and replace all your grass and never have to mow again! :)