Non-linear sigma models for non-Hermitian random matrices in symmetry classes AI$^\dagger$ and AII$^\dagger$