You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
When creating a Serve deployment with a name containing a slash (such as TextGenerationModel.options(name="huawei-noah/TinyBERT_General_4L_312D")) leads to actor failures. The error occurs because the slash in the name is likely being used as a path separator in log files.
Error: FileNotFoundError: [Errno 2] No such file or directory: '/tmp/ray/session_2025-03-11_16-02-48_264712_45753/logs/serve/replica_default_huawei-noah/TinyBERT_General_4L_312D_eo3vqu7d.log'
Versions / Dependencies
ray, version 2.43.0
Reproduction script
fromrayimportserve# The problematic model name containing a slashmodel_with_slash="huawei-noah/TinyBERT_General_4L_312D"model_without_slash="distilgpt2"# This one works fine@serve.deploymentclassMyModel:
def__init__(self, model_name):
self.model_name=model_namedef__call__(self, text):
returnf"Generated text using {self.model_name}: {text}"defmain():
serve.start()
print("Creating deployment with model name that doesn't contain a slash (works):")
working_app=MyModel.options(name=model_without_slash).bind(model_without_slash)
print("\nCreating deployment with model name that contains a slash (fails):")
try:
failing_app=MyModel.options(name=model_with_slash).bind(model_with_slash)
serve.run(failing_app)
exceptExceptionase:
print(f"Error occurred: {type(e).__name__}")
print(f"Error message: {str(e)}")
if__name__=="__main__":
main()
Issue Severity
Low: It annoys or frustrates me.
The text was updated successfully, but these errors were encountered:
crypdick
added
bug
Something that is supposed to be working; but isn't
serve
Ray Serve Related Issue
triage
Needs triage (eg: priority, bug/not-bug, and owning component)
labels
Mar 11, 2025
What happened + What you expected to happen
When creating a Serve deployment with a name containing a slash (such as
TextGenerationModel.options(name="huawei-noah/TinyBERT_General_4L_312D")
) leads to actor failures. The error occurs because the slash in the name is likely being used as a path separator in log files.Error:
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/ray/session_2025-03-11_16-02-48_264712_45753/logs/serve/replica_default_huawei-noah/TinyBERT_General_4L_312D_eo3vqu7d.log'
Versions / Dependencies
ray, version 2.43.0
Reproduction script
Issue Severity
Low: It annoys or frustrates me.
The text was updated successfully, but these errors were encountered: