You'll be fine. You'll struggle at first but everyone does. Being in good general fitness helps, but you'll condition very specifically for whatever art you're training. You can always adjunct whatever you're doing at the gym with some general fitness, strength, flexibility or whatever it is...