Control max_tokens and other params

[eli-front]

Currently there is no clear way to control max_tokens and other params with using the runWithTools

[kbhalerao]

+1 for this. I'm also wondering if tool calling is compatible with structured outputs - i.e. to be able to send the json_schema output property. It says in the docs that tools will always return JSON, so this may be unnecessary, but would love a discussion.

[dreemrworld]

Had same problem. Had to gut the whole backend again.