8000 GitHub - haruboring/pytorch_bert: Tutorial for how to build BERT from scratch
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content

Tutorial for how to build BERT from scratch

Notifications You must be signed in to change notification settings

haruboring/pytorch_bert

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

37 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Building BERT with PyTorch from scratch

img

This is the repository containing the code for a tutorial

Building BERT with PyTorch from scratch

Installation

After you clone the repository and setup virtual environment, install dependencies

pip install -r requirements.txt

Installation on Mac M1

You may experience difficulties installing tensorboard. Tensorboard requires grpcio that should be installed with extra environment variables. Read more in StackOverflow.

So, your installation line for Mac M1 should look like

export GRPC_PYTHON_BUILD_SYSTEM_OPENSSL=1
export GRPC_PYTHON_BUILD_SYSTEM_ZLIB=1

pip install -r requirements.txt

About

Tutorial for how to build BERT from scratch

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 100.0%
0