Can I reboot MT4 with the EA running?

Yes you can, but keep the downtime as short as possible when rebooting your MT4 during “market open hours”.

During the weekend when the market is closed you can restart your MT4 anytime.