BERT :dropout(): argument 'input' (position 1) must be tensor, not str

Question

0.00/5 (No votes)

See more:

i am new to nlp and i want to build a bert model for sentiment Analysis so i am following this tuto
https://curiousily.com/posts/sentiment-analysis-with-bert-and-hugging-face-using-pytorch-and-python/
but i am getting the error bellow

What I have tried:

F.softmax(model(input_ids, attention_mask), dim = 1)

When i want to execute this cell I get an error:
dropout(): argument 'input' (position 1) must be Tensor, not str

Posted 26-Dec-20 14:57pm

mohamed amine boukriba

Updated 26-Dec-20 21:33pm

v3

Add a Solution

1 solution

Add a Solution

Add your solution here

Treat my content as plain text, not as HTML

Preview 0

…

Existing Members

Sign in to your account

...or Join us

Download, Vote, Comment, Publish.

Your Email
Password
Forgot your password?

Your Email
This email is in use. Do you need your password?
Optional Password

I have read and agree to the Terms of Service and Privacy Policy
Please subscribe me to the CodeProject newsletters

When answering a question please:

Read the question carefully.
Understand that English isn't everyone's first language so be lenient of bad spelling and grammar.
If a question is poorly phrased then either ask for clarification, ignore it, or edit the question and fix the problem. Insults are not welcome.
Don't tell someone to read the manual. Chances are they have and don't get it. Provide an answer or move on to the next question.

Let's work to help developers, not make them feel stupid.

This content, along with any associated source code and files, is licensed under The Code Project Open License (CPOL)

Richard MacCutchan · Answer 1 · 2020-12-26T21:33:00

Solution 1

The error message could not be clearer. You are passing a string where it expects a Tensor object. But your question would be better directed to the writer of the tutorial.

Posted 26-Dec-20 21:33pm

Richard MacCutchan

Comments

mohamed amine boukriba 27-Dec-20 7:05am

NO i am not passing a string this the code for checking the tensors
print(input_ids.shape)
print(attention_mask.shape)
and i am getting:
torch.Size([16, 202])
torch.Size([16, 202])

Richard MacCutchan 27-Dec-20 7:12am

Well that is what the error message says, and I cannot see the code that causes the problem.

mohamed amine boukriba 27-Dec-20 7:35am

check the tuto there s code there maybe you ll find something

Richard MacCutchan 27-Dec-20 7:42am

Sorry, that is your job.

mohamed amine boukriba 27-Dec-20 7:53am

hahaha i already did that and i didn't come with anything i thought maybe you could

Richard MacCutchan 27-Dec-20 8:09am

I do not wish to be unkind. But if you follow someone else's tutorial then the writers are the people you should be asking for help.