Roman Empire not owning Rome will be an endless thorn in the side of Roman Nationalism, because the western Europeans will just point at the place and say that those guys are the actual Romans.
It should be kept as part of the Empire just for that reason.
EDIT: Also on another note, is the...