Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Docker setup doesn't support claude models #312

Closed
Denis-hamon opened this issue May 14, 2024 · 24 comments
Closed

Docker setup doesn't support claude models #312

Denis-hamon opened this issue May 14, 2024 · 24 comments

Comments

@Denis-hamon
Copy link

Capture d’écran 2024-05-14 à 09 08 17 Got this issue when I launch the app on _**xxxx:8501**_
@tedramert
Copy link

tedramert commented May 14, 2024

Same here, @Denis-hamon. Were you able to fix this?

@LawyZheng
Copy link
Collaborator

Can you describe how you set up Skyvern step by step in detail?
We can't get any useful information just from the error.

@suchintan
Copy link
Contributor

@Denis-hamon / @tedramert Did you run it through Docker or local setup?

@tedramert
Copy link

@suchintan these steps resulted in error for me

Screenshot 2024-05-15 at 10 19 04 PM

I set up my env as a contributor after 30 minutes of messing with docker configs to no avail

@Denis-hamon
Copy link
Author

@Denis-hamon / @tedramert Did you run it through Docker or local setup?

With latest version of Docker CE.
As @tedramert, I follow documentation step with docker compose setup.

@suchintan
Copy link
Contributor

@Denis-hamon / @tedramert This is really bizarre. The most common reason the streamlit file fails to create is when

CMD [ "/bin/bash", "/app/entrypoint-skyvern.sh" ]

Within the Dockerfile fails to execute.

@suchintan
Copy link
Contributor

Do you have multiple instances of postgres running? What's the output of docker ps? What about psql -l?

@Denis-hamon
Copy link
Author

Denis-hamon commented May 19, 2024

@suchintan
Docker ps gives me that :

CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
752a60b71a75 public.ecr.aws/t6d4b5t4/skyvern:latest "/bin/bash entrypoin…" 5 days ago Up 5 days 0.0.0.0:8501->8501/tcp, :::8501->8501/tcp skyvern-streamlit-1
be449fcf9f05 public.ecr.aws/t6d4b5t4/skyvern:latest "/bin/bash /app/entr…" 5 days ago Up 2 seconds skyvern-skyvern-1
d500bc008a2f postgres:14-alpine "docker-entrypoint.s…" 5 days ago Up 5 days (healthy) 5432/tcp skyvern-postgres-1

Error seems to be there when I type psql -l
psql: error: connection to server on socket "/var/run/postgresql/.s.PGSQL.5432" failed: FATAL: role "ubuntu" does not exist

@Denis-hamon
Copy link
Author

@suchintan
I ve created a role on postgre and now got this when I type psql -l

Name Owner Encoding Collate Ctype ICU Locale Locale Provider Access privileges
postgres postgres UTF8 C.UTF-8 C.UTF-8 libc
template0 postgres UTF8 C.UTF-8 C.UTF-8 libc =c/postgres +
postgres=CTc/postgres
template1 postgres UTF8 C.UTF-8 C.UTF-8 libc =c/postgres +
postgres=CTc/postgres

Unfortunately I still got the same issue when I am on the front : xxxx:8501

@suchintan
Copy link
Contributor

@Denis-hamon can you try killing all running instances of postgres and run Skyvern again? I suspect it's trying to connect to the Alpine one, not the docker one and complaining

@suchintan
Copy link
Contributor

Skyverns set up script creates the role for you

@Denis-hamon
Copy link
Author

Denis-hamon commented May 22, 2024

@suchintan , still the same issue, would you please try with this last repo version, and update installation process on a VM with Docker? I think there are something in the middle of the process that remains not automated

Many thanks

@suchintan
Copy link
Contributor

@Denis-hamon Thanks for the pushback here -- I just dug into this and found that our Docker image hasn't updated since April 7th 😱

We've pushed out a million changes since then haha.

image

@LawyZheng is looking into the script setup again to make sure things are running OK

@suchintan
Copy link
Contributor

@Denis-hamon I just pulled the latest and it works OK now. Can you give it another try?

@Denis-hamon
Copy link
Author

@suchintan I tried again and unfortunately, it' still the same error.

@suchintan
Copy link
Contributor

Can you share your docker PS output again? @Denis-hamon

@LawyZheng
Copy link
Collaborator

@Denis-hamon make sure about 2 things:

  1. Deleting the old Skyvern image, make sure you're going to pull the latest one.
  2. Make sure your .streamlit/secrets.yml has been deleted before you restart the container.

@Denis-hamon
Copy link
Author

Denis-hamon commented May 24, 2024

@suchintan

It can 't be that because :

  1. I created a new Virtual machine completely new with
  • OS Ubuntu 24 last update
  • Docker last update
  • Python last stable version
  • Postgre last update
  1. There is no .streamlit/secrets.yml in .streamlit directory

@suchintan
Copy link
Contributor

@Denis-hamon you don't need postgres or python to run Skyvern via Docker

Two questions:

  1. Are you running Docker Desktop?
  2. Are you just docker compose up -d? Or are you also running the setup scripts

@Denis-hamon
Copy link
Author

@suchintan

  • I have python and postgre installed on my VM , not specifically though my Docker container
  • I am running Docker engine compatible with Ubuntu 24
  • I just made docker compose up -d , I am not executing the setup scripts mentionned like ./setup.sh or ./run_skyvern.sh

@suchintan
Copy link
Contributor

@Denis-hamon would it be helpful if we hopped on a quick call? I'd love to rapidfire a few configurations with you. Are you free at 2:30pm EST today? Do you want to follow up over email? suchintan@skyvern.com

@Denis-hamon
Copy link
Author

Sent :)
Many thanks
Denis

@suchintan
Copy link
Contributor

We hopped on a call and got to the bottom of the issue:

When you set the LLM Provider to be Claude and don't specify OpenAI API key.. the Skyvern service fails to start correctly and blows up

@suchintan suchintan changed the title Streamlit config issue Docker setup doesn't support claude models May 24, 2024
@linear linear bot closed this as completed May 28, 2024
@LawyZheng
Copy link
Collaborator

@Denis-hamon we have fixed this bug and will release the latest version this week.
Could you try it again after the new version?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants