The fact that Marie Louise was forced to leave her son is not in dispute. She was only permitted to occasionally see him and Napoleon’s son (Napoleon, renamed Franz) was never permitted to visit his mother’s Duchies in Italy - which the Treaty of Fontainebleau assured to his possession as an inheritance.
After the death of Napoleon, Marie Louise warned him that he might be next.