Skip to content
forked from naver-ai/usdm

Official PyTorch implementation of "Paralinguistics-Aware Speech-Empowered LLMs for Natural Conversation" (NeurIPS 2024)

License

Notifications You must be signed in to change notification settings

Rubiginosa/usdm

 
 

Repository files navigation

Contributions

Rubiginosa:

  • Modified inference.py and ran models
  • Implemented and performed evaluation
  • Annotated Speech Accent Archive samples

Csammat1:

  • Created functioning condacolab environment & setup
  • created whispr notebook
  • prepared paper

Original work is copyright NAVER Cloud Corp.

License

USDM
Copyright (c) 2024-present NAVER Cloud Corp.
Licensed under the Apache License, Version 2.0 (the "License");
you may not use this file except in compliance with the License.
You may obtain a copy of the License at
    http://www.apache.org/licenses/LICENSE-2.0
Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.

About

Official PyTorch implementation of "Paralinguistics-Aware Speech-Empowered LLMs for Natural Conversation" (NeurIPS 2024)

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 78.1%
  • Jupyter Notebook 21.9%