I noticed if you go mess around in arcade and don't play well it will drop your hidden rank that the game tries to drift you towards.
In random brawl I generally just charge in and have fun, but I noticed if you go to ranked after, a win will get you few points and a loss will drop you a ton...