Generate multiple responses for the same prompt in predict

[Mario-RC]

I have done Supervised Fine-Tuning on a llama2 model, and I would like to be able to get multiple responses for the same prompt using Predict. I would like to be able to adjust the temperature, top_k, top_p, ...

[hiyouga]

Please use the demo API, we provide various parameters including n, top_p, etc.