I use Aldi as well, but the only time I will go is Sunday morning.
I've found the best time for turning up is half an hour after it opens.
The scrotes are either still in bed or having a pre- shop mcdonalds, and the initial rush of people who wait outside for it to open has subsided.
I got there about 1:15 no queue to get in and fairly quiet. I have a Waitrose minutes walk from me but not only is it extortionate it is always packed.