Skip to content

Commit

Permalink
Format spaces
Browse files Browse the repository at this point in the history
  • Loading branch information
Ningchen-Wang authored Aug 13, 2021
1 parent b78f027 commit e34e8fe
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion examples/unsupervised_learning/MLM/train_mlm.py
Original file line number Diff line number Diff line change
Expand Up @@ -27,7 +27,7 @@
use_fp16 = False #Set to True, if your GPU supports FP16 operations
max_length = 100 #Max length for a text input
do_whole_word_mask = True #If set to true, whole words are masked
mlm_prob = 0.15 #Probability that a word is replaced by a [MASK] token
mlm_prob = 0.15 #Probability that a word is replaced by a [MASK] token

# Load the model
model = AutoModelForMaskedLM.from_pretrained(model_name)
Expand Down

0 comments on commit e34e8fe

Please sign in to comment.