Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Nvidia Jetson tensorflow version -- mismatch #1101

Open
Ahrovan opened this issue Feb 23, 2023 · 8 comments
Open

Nvidia Jetson tensorflow version -- mismatch #1101

Ahrovan opened this issue Feb 23, 2023 · 8 comments

Comments

@Ahrovan
Copy link

Ahrovan commented Feb 23, 2023

  • According to the installation doc for Nvidia Jetson, will be installed tensorflow==2.3.1
  • According to the installation doc for Host PC ubuntu, will be installed tensorflow==2.2.0
  • After creating the model in Host and move it to Jetson, the following error is displayed:
  File "/home/ahrovan/env2/lib/python3.6/site-packages/tensorflow/python/framework/ops.py", line 6843, in raise_from_not_ok_status
    six.raise_from(core._status_to_exception(e.code, message), None)
  File "<string>", line 3, in raise_from
tensorflow.python.framework.errors_impl.InvalidArgumentError: Matrix size-incompatible: In[0]: [1,67712], In[1]: [6656,100] [Op:MatMul]
  • But when the model is trained in Jetson. Runs without problems.

Why are different versions of Tensorflow incompatible? And if they do not match. Why these versions not corrected in the documents?

@Ahrovan Ahrovan changed the title Nvidia Jetson mismatch Nvidia Jetson tensorflow version -- mismatch Feb 23, 2023
@Ahrovan
Copy link
Author

Ahrovan commented Feb 23, 2023

@DocGarbanzo Is this problem related to tensorflow version 2.3.1?
tf_2_9 Can be installed and used?

@DocGarbanzo
Copy link
Contributor

DocGarbanzo commented Feb 24, 2023

@Ahrovan - can you check that you have the same image setting on your trained model as well as on your robot. I.e. IMAGE_W, IMAGE_H in your myconfig.py? The tf_2_9 branch will be merged to main soon. Please note, the jetson installation for that will be quite tricky, so please wait until we have published the instructions to the docs, because it's very unlikely you'll get it to work without them.

@Ezward
Copy link
Contributor

Ezward commented Feb 27, 2023

ubuntu.yml installs tensorflow 2.2.0, see ubuntu.yml#L39 but Jetson Nano installs 2.3.1, see docs setup_jetson_nano.md#L66

In addition mac.yml installs tensorflow 2.2.0, see mac.yml#L43

Windows docs also shows to install TF 2.2.0, see setup_windows.md#L59 and setup_windows.md#L69

@Ahrovan
Copy link
Author

Ahrovan commented Feb 27, 2023

pip install tensorflow==2.3.1 in PC Host env/conda solved. just need test. working on it...

@Ezward
Copy link
Contributor

Ezward commented Mar 6, 2023

We have to do a little work here; I think the final fix will be when @DocGarbanzo lands the tensorflow 2.9 branch; then both raspberry pi and jetson nano will use the same version, so we can update the docs to that version.

@Ahrovan
Copy link
Author

Ahrovan commented Mar 6, 2023

Please update asap. Thank you

@Ahrovan Ahrovan closed this as completed Mar 6, 2023
@Ezward
Copy link
Contributor

Ezward commented Mar 6, 2023

@Ahrovan you have a workaround, is that correct? I am re-opening; this is a real issue and we appreciate you bringing this up. I will close when the tf 2.9 branch lands.

@Ezward Ezward reopened this Mar 6, 2023
@Ahrovan
Copy link
Author

Ahrovan commented Mar 16, 2023

image
I have prepared this table. Please note that there may be minor mistakes.
One thing is very important. Tensorflow or pytorch user should choose only one. There are many problems in lower versions of JetPack.
@Ezward

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants