Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Joystream GPT #779

Open
bedeho opened this issue Jan 12, 2024 · 5 comments
Open

Joystream GPT #779

bedeho opened this issue Jan 12, 2024 · 5 comments
Assignees

Comments

@bedeho
Copy link
Member

bedeho commented Jan 12, 2024

People may have a question they want to ask, which is hard to anticipate, and the answer may very well lie across all the data we have about Joystream, like the handbook, roadmap/website, blog posts, github issues, forum, etc. What if there was a super easy way on our website, e.g. part of the landing page or dashboard, where the user can get a chatgpt style prompt to be able to answer all such quetsions, with visuals, tables and all the sort of powerful presentation. The user could ask super arbitrary things, like "when will all tokens be ciruclating" or "why is there no max cap" or "how many videos are there on joystream", etc.

I'm sure there are very powerful tools now for launching customized GPTs, and the UI layer probably also comes out ofthe box.

@leetjoy
Copy link

leetjoy commented Jan 12, 2024

I had a call with these guys (https://www.hashmail.dev/) and tested their tool (tried to teach GPT with Joystream handbook & lightpaper) and got pretty solid results, they do also have option to connect with support (HR workers?) using Telegram if GPT cannot provide an answer
image

@bedeho
Copy link
Member Author

bedeho commented Jan 21, 2024

Another option: https://www.chatbase.co/

@DzhideX
Copy link
Contributor

DzhideX commented Apr 1, 2024

I looked into the 2 options you mentioned as well as another I found online and here's a short overview of my findings:

  • Chatbase:
    • Price: $19/Month - $99/Month - $399/Month
    • Messages: 2000/Month - 10000/Month - 40000/Month
    • Model: GPT3 - GPT-4/GPT-4 Turbo
    • Trainable chars: 11M/bot - infinite
    • Integrations: chatbot iframe OR chat bubble at bottom right
    • Rate limiting: ✅ (can set # of messages per # of seconds)
    • Customizable chat interface: ✅
    • Training:
      • Files (.pdfs, .txts, .docxs, ..) can be easily uploaded.
      • Website URLs can be provided and it will crawl all of the routes and read data from them.
    • Other:
      • Great dashboard, has access to chat logs and user analytics.
  • Hashmail:
    • Price: $99/Month
    • Messages: infinite?
    • Model: not sure?
    • Trainable characters: Was able to train lightpaper.pdf, gitbook, joystream.org with no issues.
    • Integrations: chat bubble
    • Rate limiting: ❌ (there is no need for it as it seems there’s no limit to # of messages).
    • Customizable chat interface: ✅
    • Training:
      • Files: Allows for uploads of .pdfs only.
      • Website URLs can be provided and it will crawl all of the routes and read data from them.
    • Other:
      • The dashboard is annoying to use and occasionally has difficulties in certain workflows.
      • Not impressed with quality of answers.
      • Their docs page didn't work.
      • By default needs wallet to work. There is a non-wallet solution but dashboard won’t open it.
  • Chatbot.com:
    • Price: $65/Month - $169/Month - $499/Month
    • Messages: 1k Chats/Month - 5k Chats/Month - 25k Chats/Month
      • A chat is multiple messages, not detailed exactly how many.
    • Model: not sure?
    • Trainable characters: 5000 content sources (in this case, one source was one route ~ this is plenty)
    • Integrations: chat bubble
    • Rate limiting: ❌
    • Customizable chat interface: ✅
    • Training: Website URLs. No files.
    • Dashboard:
      • Well built, workflows easy to execute.
      • Quality of answers mediocre, less powerful than chatbase.

My recommendation

If I had to choose I would definitely go with Chatbase prioritizing both the $19/Month and $99/Month over other solutions. They have a great dashboard that's easy to use and quite feature-rich. My "benchmark" prompt for all of them was to ask for the JOY token genesis distribution (formatted as a table) and only Chatbase was able to give me an acceptable answer (even with the gpt3.5 version which is surprisingly powerful). The 11M+ characters should also be way more than enough for all of the Joystream information we have available online. The only downside is the relatively short message count but I think the trade-off is worth due to its better performance.

@bedeho
Copy link
Member Author

bedeho commented Apr 1, 2024

Thanks for doing this review.

What would be the form factor for this chat interaction? where would it be happening?

@DzhideX
Copy link
Contributor

DzhideX commented Apr 1, 2024

The form factor would be a chat bubble found on the bottom right part of the page. This chat bubble would be available on all pages of the website. There's also an option to integrate an iframe (similar to changenow) somewhere on the website but we will probably need some design work for that.

How it looks:
Screenshot 2024-04-01 at 15 37 01
Screenshot 2024-04-01 at 15 37 46

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants