If the shared allocation hasn't been removed up to this point,
then remove it when freeing the pointer.
No need to check if ptr is still in the map, as erase would
automatically return 0 if not found.
Signed-off-by: Jaime Arteaga <jaime.a.arteaga.molina@intel.com>