An example for MOSS-TTS-Local-Transformer

[nick-morhun]

Everywhere in the documentation MOSS-TTS-Local-Transformer is mentioned alongside MOSS-TTS. Is my assumption correct that the same code will work for both models?
I am trying to run moss_tts_app.py with MOSS-TTS-Local-Transformer. I am getting next error:

Traceback (most recent call last):
  File "/home/nickmorhun/.pyenv/versions/mossTTSenv/lib/python3.12/site-packages/gradio/queueing.py", line 766, in process_events
    response = await route_utils.call_process_api(
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/nickmorhun/.pyenv/versions/mossTTSenv/lib/python3.12/site-packages/gradio/route_utils.py", line 355, in call_process_api
    output = await app.get_blocks().process_api(
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/nickmorhun/.pyenv/versions/mossTTSenv/lib/python3.12/site-packages/gradio/blocks.py", line 2152, in process_api
    result = await self.call_function(
             ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/nickmorhun/.pyenv/versions/mossTTSenv/lib/python3.12/site-packages/gradio/blocks.py", line 1629, in call_function
    prediction = await anyio.to_thread.run_sync(  # type: ignore
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/nickmorhun/.pyenv/versions/mossTTSenv/lib/python3.12/site-packages/anyio/to_thread.py", line 63, in run_sync
    return await get_async_backend().run_sync_in_worker_thread(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/nickmorhun/.pyenv/versions/mossTTSenv/lib/python3.12/site-packages/anyio/_backends/_asyncio.py", line 2502, in run_sync_in_worker_thread
    return await future
           ^^^^^^^^^^^^
  File "/home/nickmorhun/.pyenv/versions/mossTTSenv/lib/python3.12/site-packages/anyio/_backends/_asyncio.py", line 986, in run
    result = context.run(func, *args)
             ^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/nickmorhun/.pyenv/versions/mossTTSenv/lib/python3.12/site-packages/gradio/utils.py", line 1036, in wrapper
    response = f(*args, **kwargs)
               ^^^^^^^^^^^^^^^^^^
  File "/home/nickmorhun/MOSS-TTS/clis/moss_tts_app.py", line 546, in <lambda>
    fn=lambda text, reference_audio, mode_with_reference, duration_control_enabled, duration_tokens, temperature, top_p, top_k, repetition_penalty, max_new_tokens: run_inference(
                                                                                                                                                                    ^^^^^^^^^^^^^^
  File "/home/nickmorhun/MOSS-TTS/clis/moss_tts_app.py", line 329, in run_inference
    outputs = model.generate(
              ^^^^^^^^^^^^^^^
  File "/home/nickmorhun/.pyenv/versions/mossTTSenv/lib/python3.12/site-packages/torch/utils/_contextlib.py", line 120, in decorate_context
    return func(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^
  File "/home/nickmorhun/.pyenv/versions/mossTTSenv/lib/python3.12/site-packages/transformers/generation/utils.py", line 2496, in generate
    self._validate_model_kwargs(model_kwargs.copy())
  File "/home/nickmorhun/.pyenv/versions/mossTTSenv/lib/python3.12/site-packages/transformers/generation/utils.py", line 1661, in _validate_model_kwargs
    raise ValueError(
ValueError: The following `model_kwargs` are not used by the model: ['audio_temperature', 'audio_top_p', 'audio_top_k', 'audio_repetition_penalty'] (note: typos in the generate arguments will also show up in this list)

[chille9]

I using Windows & I'm getting similar errors. I changed the model it was looking for in "moss_tts_app.py" from MODEL_PATH = "OpenMOSS-Team/MOSS-TTS" to MODEL_PATH = "OpenMOSS-Team/[MOSS-TTS-Local-Transformer" but then I get different errors, it seems according to Google Ai Studio there are some lines of code in "modeling_moss_tts.py" & "modeling_moss_tts.py" that needs to be changed before it will work. I used all my free Google Ai Studio time, so I wasn't to correct it.

were you able to solve it? Also getting errors starting it up on windows.

[epicstar7]

Try running it via pinokio, works like a charm.

[nick-morhun]

I using Windows & I'm getting similar errors. I changed the model it was looking for in "moss_tts_app.py" from MODEL_PATH = "OpenMOSS-Team/MOSS-TTS" to MODEL_PATH = "OpenMOSS-Team/[MOSS-TTS-Local-Transformer" but then I get different errors, it seems according to Google Ai Studio there are some lines of code in "modeling_moss_tts.py" & "modeling_moss_tts.py" that needs to be changed before it will work. I used all my free Google Ai Studio time, so I wasn't to correct it.

were you able to solve it? Also getting errors starting it up on windows.

You could try the Colab notebook by TeamAIQ.

[chille9]

Try running it via pinokio, works like a charm.

Via pinokio is the only way it works currently. Thanks for the tip.