The Gatwick Express isn’t that much faster unless it’s the next train
Don’t bother buying a ticket to Brighton, buy one to Haywards Heath and use your match ticket from there
EDIT - this link gives you train times off VIC to Haywards, but you might need to change to reach Brighton...