AI4D Malawi News Classification Challenge
'/%3e%3c/g%3e%3cuse xlink:href='%23b' transform='rotate(10)'/%3e%3c/g%3e%3cuse xlink:href='%23c' transform='rotate(20)'/%3e%3c/g%3e%3cuse xlink:href='%23d' transform='rotate(40)'/%3e%3c/g%3e%3cuse xlink:href='%23e' transform='rotate(-80)'/%3e%3c/g%3e%3cpath d='M-225-21.5h450v7.5h-450z'/%3e%3cpath fill='%23339E35' d='M-225 86h450v100h-450z'/%3e%3c/svg%3e)
Helping Malawi
$2 000 USD
Completed (almost 5 years ago)
Classification
830 joined
322 active
Start
Jan 22, 21
Close
May 09, 21
Reveal
May 09, 21
BERT with Tensorflow
Help · 27 Feb 2021, 09:54 · 5
Has anyone using Bert with tensorflow encountered thie following warning:
WARNING:tensorflow:It seems that global step (tf.train.get_global_step) has not been increased. Current value (could be stable): 118 vs previous value: 118. You could increase the global step by passing tf.train.get_global_step() to Optimizer.apply_gradients or Optimizer.minimize.
If yes. How can we " increase the global step by passing tf.train.get_global_step() to Optimizer.apply_gradients or Optimizer.minimize ". Thanks.
use tf hub and version 2
okay cool. Thanks.
How you guys are using transformers for non-English text, mainly when we don't have pre-trained transformers models for Chichewa language.
@Chetan_Ambi Yea. i know. You're very right.
you can ugse translation or you can use simple bert and fine tune it, by adding LSTM and Multile Dense layers