I couldn't figure out why my submissions were always getting scores of 1. Turns out it is because in my submission file, the score numbers were floats (1.0 and 0.0) rather than integers (1 and 0).
... so I'm posting this here in case anyone else has the same problem! Make sure your submission file contains integers, not floats!