Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support OpenAI Assistants + Threads #315

Open
burn2delete opened this issue Apr 24, 2024 · 8 comments
Open

Support OpenAI Assistants + Threads #315

burn2delete opened this issue Apr 24, 2024 · 8 comments

Comments

@burn2delete
Copy link

Hello,

I wanted to update the template to use OpenAI Assistants + Threads. In the comments it says it's supported but I can't seem to figure out where I can update this.

@athrael-soju
Copy link

There isn't really any implementation of Assistants in the template, so you'd have to implement it from scratch. There's a lot of reusable code though, and tools/GenUI work well with Assistants too, So You can draw inspiration from that.

@kevb10
Copy link

kevb10 commented May 9, 2024

... but I can't seem to figure out where I can update this

submitUserMessage() function in lib/chat/actions.tsx is probably a good start

@GoodestUsername
Copy link

@athrael-soju
How does genUI work with assistants?

@smuk3c
Copy link

smuk3c commented May 15, 2024

Same question here

@smuk3c
Copy link

smuk3c commented May 18, 2024

@burn2delete did you manage to replace completion with assistant?

@BaileySimrell
Copy link

I spent quite a bit of time yesterday trying to get this template to work with OpenAI Assistants ... did not have any luck tbh

Kept running into one issue after another.

It's not just the lib/chat/actions.tsx file that needs to be updated ... all of the logic that currently stores messages and maps the messages to threads and threads to users in Vercel KV also needs to be updated to instead store thread IDs of the Assistant threads in OpenAI. Vercel KV can be used to keep track of which threads belong to which user, but there's no need to store all messages in KV anymore.

It would be really great if the maintainers of this template created a version that worked out of the box with OAI Assistants. Would be much more powerful.

Some of the stock UI streaming stuff is overkill and takes a long time to remove from the template. Very cool demo though.

@athrael-soju
Copy link

@athrael-soju How does genUI work with assistants?

Sorry for the late reply. Just saw this.

Assistants can also use function calls, but this template is too embedded with Completions API via Vercel AI and also has several unresolved issues. I really wouldn't suggest you integrate assistants here and instead use this: https://github.com/openai/openai-assistants-quickstart

You can then integrate genUI on top of that template instead.

Either that, or wait for the next Vercel genUI template, which will likely be based on next.js 15 and hopefully less buggy.

I hope that helps.

@BaileySimrell
Copy link

BaileySimrell commented May 26, 2024

@athrael-soju How does genUI work with assistants?

Sorry for the late reply. Just saw this.

Assistants can also use function calls, but this template is too embedded with Completions API via Vercel AI and also has several unresolved issues. I really wouldn't suggest you integrate assistants here and instead use this: https://github.com/openai/openai-assistants-quickstart

You can then integrate genUI on top of that template instead.

Either that, or wait for the next Vercel genUI template, which will likely be based on next.js 15 and hopefully less buggy.

I hope that helps.

I agree with this ... the OpenAI template is very good, though the UI is bare bones (https://github.com/openai/openai-assistants-quickstart)[https://github.com/openai/openai-assistants-quickstart]

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

6 participants