So... I was upgrading my PSU just now, after plugging in back everything, pushed the power button, nothing happened.
Shit, went through all the wiring again, tried, still not working.
Finally, looked at the back of the unit, there's an ON/OFF switch, F*CK!