I played few games with Terrans on Genius and had no problems winnings despite being noob. Mostly won because AI ships were slow and ineffective, so as long as I had one proper fleet, it could pick them all up.
Now I started game with Altarians, one level higher difficulty, medium map again. Neglected military in beginning and Terrans started war after 65 turns. Was thinking building few durantium driver prototype ships quickly and pushing AI back, but got attacked with fleets of medium ships I had designed in last games. I had no idea that could happen... M-boat (7 moves, 24 missile attack, 16 shield), Heavy Frigates (9 moves, 32 kinetic from D-drive prototypes, all 3 types of armor). I got my ass kicked so bad and lost all planet expect home world in 20 turns 
If this happens with all races, adding few good ship designs for them could make the game much harder.