Out of the proposed options, the best one was 3 walls and two sprites, with one sprite being sacrificed. This strategy is good because it works for almost any map where the sprites' speed on grass is reduced by one.
If you're looking for a solution with 2 walls, there are quite a few ways to deal with 3 walls and one fake sprite. I found at least 8 solutions. There are also a couple of options where, after the second wall, a stack of 20 imps remains, which can be finished off with a stack of sprites without losses with normal RNG, but this is at the expense of the second criterion of the puzzle.