Quantcast
Channel: Active questions tagged python - Stack Overflow
Viewing all articles
Browse latest Browse all 13951

Response message is not displayed in the gradio UI which runs a python script for openai chat model

$
0
0

I have the following problem at creation of an openai chatbot model:

The assistant replies are not displayed in the gradio chatbox. Only the user input is displayed. There are no errors or warnings in the UI nor in the console.The response object includes very good assistant's messages, but they are lost on the way to the gradio display.

I am using recently updated version of gradio, python 3.x and the gpt-3.5-turbo-0125 model

Here is the script function passed to gradio:

def predict(message, history):    response = get_completion(messages)    for choice in response.choices:        if choice.finish_reason == "stop":            break        if choice.finish_reason == "tool_calls":            fn_name = choice.message["function_call"].name            arguments = choice.message["function_call"].arguments            function = locals()[fn_name]            result = function(**arguments)            messages.append(                {"role": "assistant","content": None,"function_call": {"name": fn_name,"arguments": arguments,                    },                }            )            messages.append(                {"role": "function","name": fn_name,"content": f'{{"result": {str(result)} }}'                }            )        else:            messages.append(choice.message["content"])        response = get_completion(messages)

Here is the response object (includes message I want to see in the UI):

ChatCompletion(id='chatcmpl-8shL0R1lKV3xgLxqUs6bsUkpydwCm', choices=[Choice(finish_reason='stop', index=0, logprobs=None, message=ChatCompletionMessage(content='To calculate the price for Simple Reservations, I need the following information from you:\n\n1. Number of users who will be using the software.\n2. Number of rooms that you want to manage.\n3. Are you a first-time client, or have you used Simple Reservations before?\n\nCan you please provide me with these details?', role='assistant', function_call=None, tool_calls=None))], created=1708046994, model='gpt-3.5-turbo-0125', object='chat.completion', system_fingerprint='fp_9fdfea22a2', usage=CompletionUsage(completion_tokens=68, prompt_tokens=156, total_tokens=224))

Viewing all articles
Browse latest Browse all 13951

Trending Articles



<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>