That seems to say there is no OSCustomizationSpec by that name.
Do you see it when you do

Get-OSCustomizationSpec

In fact, if that OSCustomization might not be there in some cases, you could perhaps better do

Get-OSCustomizationSpec -Name Temp -ErrorAction SilentlyContinue | Remove-OSCustomizationSpec -Confirm:$false