Skip to content

Conversation

@MurugeshMarvel
Copy link

  • Changed the way of calling modeling_bert and modeling_gpt2 modules based on the transformer v3.x
  • Replaced BertLayerNorm with torch.nn.LayerNorm

@ink-pad
Copy link
Collaborator

ink-pad commented Jul 27, 2021

Thank you so much, @MurugeshMarvel!

I will review this soon!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants