Engagement / Document Library / Intel® Deep Learning Boost - Improve Inference Performance of BERT Base Model from Hugging Face for Network Security Technology Guide
Intel® Deep Learning Boost - Improve Inference Performance of BERT Base Model from Hugging Face for Network Security Technology Guide
Intel® Deep Learning Boost - Improve Inference Performance of BERT Base Model from Hugging Face for Network Security Technology Guide
https://networkbuilders.intel.com/solutionslibrary/intel-deep-learning-boost-improve-inference-performance-of-bert-base-model-from-hugging-face-for-network-security-technology-guide
Last Updated: Jan 10, 2023
PyTorch* is one of the widely used deep-learning frameworks. To boost the performance under Intel® hardware, Intel provides the open-source Intel® Extension for PyTorch* (IPEX) with latest feature optimizations. This guide illustrates how to use PyTorch and Intel IPEX tool to boost deep-learning inference performance on Hugging Face BERT base model (cased). The guide also shows a gen-2-gen performance comparison between the 3rd Gen Intel® Xeon® Scalable processor and the 4th Gen Intel® Xeon® Scalable processor.