Add score_batch to Generator #156

Job	Run time
check	11s
build-windows (openblas)	6m 40s
build-macos (macos-13, ruy)	9m 18s
build-linux (ruy)	2m 31s
build-windows (openblas, flash-attention)	6m 41s
build-macos (macos-13, ruy, flash-attention)	8m 2s
build-linux (ruy, flash-attention)	2m 15s
build-windows (ruy)	6m 45s
build-macos (macos-13, accelerate)	7m 20s
build-linux (mkl)	5m 4s
build-windows (ruy, flash-attention)	8m 27s
build-macos (macos-13, accelerate, flash-attention)	6m 47s
build-linux (mkl, flash-attention)	4m 54s
build-macos (macos-14, ruy)	3m 8s
build-linux (openblas)	2m 46s
build-macos (macos-14, ruy, flash-attention)	3m 9s
build-linux (openblas, flash-attention)	2m 51s
build-macos (macos-14, accelerate)	2m 52s
build-macos (macos-14, accelerate, flash-attention)	2m 47s
	1h 32m 28s

Provide feedback