In relatively unscientific tests, it seems moving from PHP5.4 with xcache to PHP 5.6 with Zend’s OpCache can lead to approximately 50% memory reduction.
(xcache was set to have a 64mb size, Zend OpCache is also using 64mb of memory).
The moment/time of upgrade is fairly obvious…