AARCH64 CUDA 12.4.1 wheels "In-compatible" with conda's numpy 2.x conda packages

[nWEIdia]

See PR comments in #1984 for details.

Summary: (all aarch64 specific)

CUDA 12.4.0 wheel (e.g. pick 08/01/2024 nightly) works with conda numpy, 1.x as well as 2.x
CUDA 12.4.1 wheel (e.g. pick 08/26/2024 nightly) works ONLY with conda numpy 1.x, not 2.x. It works with PYPI numpy 2.x.

Need to root-cause while applying a workaround (i.e. #1984) to unblock nightly as well as v2.5.0

cc @atalman @malfet @ptrblck @tinglvv