What is the appropriate approach to submit the results of the testset ? probability sense or 0,1,0
Probability sense [0.334, 0.600, 0.176].
Check the evaluation page.
As log loss is being used for evaluation you should submit probabilities. If you take the max and submit 1s and 0s your log loss error will be very high unless your model predicts every single image correctly.