Test PR: Remove numpy dependency, let Pandas introduce it

[dougbrn]

Pandas has a numpy dependency. Try letting Pandas handle it's installation. This still fails as Pandas does not pin to <2.0

[github-actions]

Before [c44bfe1]	After [ea4e04f]	Ratio	Benchmark (Parameter)
61.9±2ms	62.2±2ms	1.01	benchmarks.ReassignHalfOfNestedSeries.time_run
260M	259M	1	benchmarks.AssignSingleDfToNestedSeries.peakmem_run
90.7M	90.6M	1	benchmarks.NestedFrameQuery.peakmem_run
87.6M	87.4M	1	benchmarks.NestedFrameReduce.peakmem_run
84.8M	84.3M	0.99	benchmarks.NestedFrameAddNested.peakmem_run
275M	271M	0.99	benchmarks.ReassignHalfOfNestedSeries.peakmem_run
9.37±0.2ms	9.17±0.06ms	0.98	benchmarks.NestedFrameAddNested.time_run
6.40±0.1ms	6.23±0.2ms	0.97	benchmarks.NestedFrameQuery.time_run
33.0±4ms	31.5±0.5ms	0.95	benchmarks.AssignSingleDfToNestedSeries.time_run
1.12±0.01ms	1.06±0.01ms	0.94	benchmarks.NestedFrameReduce.time_run

Click here to view all benchmarks.