Pre-trained BERT now available on the Peltarion Platform

BERT is a complex model, with many stacked layers and different parameters - 12 stacked layers and 110 million parametres to be exact. Therefore, building and training a BERT model from scratch is very expensive, takes a lot of time and requires huge amounts of data. This is why we provide a pre-trained BERT model so that you only need to input your data and define the size of the vocabulary you want to use.

What used to be an expensive and complex process requiring weeks and weeks of training and knowledge of which specific code libraries to use, is now a few clicks job to achieve. Using BERT on the Peltarion Platform gives you access to a pre-trained BERT model. This model is capable of providing very accurate results, even when training on a small dataset.

Being able to train an existing BERT model on some domain-specific topics with a small amount of labeled data and short training time, can enable numerous companies to build business value, quickly.