/Python/How to add special token to bert tokenizer

How to add special token to bert tokenizer

special_tokens_dict = {'additional_special_tokens': ['[C1]','[C2]','[C3]','[C4]']}
num_added_toks = tokenizer.add_special_tokens(special_tokens_dict)
model.resize_token_embeddings(len(tokenizer))

Similar codes

0 vote241 views1 answer
Split path in list of directories
Python
0 vote241 views1 answer
Python django model range validation
Python
1 vote249 views1 answer
Numpy dot product
Python
0 vote232 views1 answer
How to add percentage in countplot
Python
2 votes238 views3 answers
Make button in tk
Python
45 votes231 views4 answers
Append to front of list python
Python
0 vote306 views1 answer
Randomly shuffle pandas dataframe
Python
0 vote259 views1 answer
Python calling method from constructor
Python
0 vote265 views1 answer
Seeparate string without split function python
Python
0 vote247 views1 answer
No module named googlesearch
Python