Training BERT from scratch (MLM+NSP) on a new domain

🤗Transformers
11

Is there any limit for vocab size ??
I don’t think so … if there limit please explain why can’t we increase the vocab size more than 50k ?
What will happen if we do so ???